I can see what you mean. I went to AnimeNEXT back in June, and the place it was at was like... a big complex of hotels and such... It was packed even if the convention wasn't there, and no one knew what was up with the wacky attire flooding the area. So many questions were asked, especially to my friend who was cosplaying. I wasn't, but my fuschia kitty ears hat and semi-rainbow brite attire was still getting me stared at.
It's tough with the "crazy" styles of Japanese fashion. I've never really done it to any bit of 'extreme' but I can imagine. I was attacked for wearing skulls & camouflage on a regular basis my freshman year of high school... And looked at as a member of the Bloods for wearing a lot of red and black. I had to withstand the abuse... Then when I altered my 'style' a bit, and added more color, and laid my eyeliner on thicker and more like this:
(mind you, my hair was still its natural brown), I was getting looked at as if I were a pothead. It was just not cool at all... I still get a crap, but no one says anything to my face anymore because I'd just get downright nasty because of the things being said to me.
Some people just are all-round mean and ignorant. It's not guaranteed to work if you wear what you wear comfortably and confidently 100%... But I realized it does do something. Then again, I'll say I've never sported harajuku style, or decora... Or anything out in public. The most I've done is worn my Kanon-inspired haircut styled and spiked out to the side a bit.