If you're not in Tokyo or another large city, it can seem like you're completely out of luck. Almost no one will speak English. Signs will seldom be in English and when they are they will seldomly be useful.
But stop by city hall and see if they have an international department. Usually these offices can point you to English resources, tell you about Japanese classes, give you guidebooks and maps in English, etc.
Gambatte!
gaijzilla.com