No they don't, they are naked and it's just not in their culture to find that very weird.
Personally, before I might have been shy and stuff but now I decided I don't give a damn. I think hotsprings look really nice and relaxing so I wouldn't be bothered for the sake of my own relaxation. We shouldn't be ashamed of our natural human bodies
[Note to mod- please merge this with onsen thread.]