There is a big demand for English teachers in Japan. That would get you a stay for at least a little while.
I've asked basically the same question on another forum before and the responses I got were basically have at least a bachlor's degree in a certain field of work, preferably something that would benefit Japanese people. Then to have a good amount of experience in that field of work before you move to Japan.
Good luck!