I've loved Japanese stories and animation since I was a kid. Something draws me to them, the amount of philsophy and character development or something. All my friends used to think I was a bit eccentric for doing so. (and probably for other reasons.) Its just in the past 3 years that Anime has really taken off here. Almost all students know about Naruto, Bleach and movies like Spirited Away etc. My friends are the same, whereas before they were skepitcal of shows like DragonBall Z and Trigun, now they're in love with them.
Its really human nature. People either are open to something, or totally against it because they're ignorant and prejudiced.
Don't take it personally.