disfunkd,
I can see where you're coming from. I dumped my last girlfriend of 3 years so that I could move across the country to live amongst the mountains. In retrospect, it was a great decision. I may be single but I'm probably the happiest single guy around.
However, in my case, I did a ton of research instead of following my heart. I visited my future town twice and even spent a month living there as I talked to many of the locals and transients.
You're still young and I encourage you to do what's best for you. Don't settle down if you're not ready to do so. But at the same time, do your research! Japan is a mystical country which attracts a lot of people for various reasons but it does have its share of negatives as well! Going to Japan because of your interest in anime, cars, music, etc. is like chasing a girl for the tattoo's on her back.
Check out some other forums as well - gaijinpot.com is the central hub for foreigners living in Japan. You can check out that site but be prepared. Those guys are a lot less forgiving than the users on this site.