[Nagoyankee]

Personally, I think that the more anime you watch, the more misunderstood you will become about Japan. Games are out of the question if I may say so.

You have raised a good question, though. It's something that many self-claimed "Japan fans", which are numerous right here on JF, don't seem to ask themselves.

My recommendations are:

Books
Japan, Past and Present by Edwin O. Reischauer

Pictures from the Water Trade by John David Morley

A Mature Woman by Saiichi Maruya

Films
Tora-san series
Tsuri-baka Nisshi series