I found the same thing when I was in Osaka at first. But as you get to know them, and the longer you are there, they begin to surmise that you should be learning Japanese and speak in less and less English ;p At first I wanted them to speak in Japanese, and just before I was leaving I was hoping they would go easy on me and use less Japanese