Yea I don't think you'll have so much of a problem, especially if you are willing to put a lot of effort into it, like you said!
It might help to take a summer class or something like in Japanese or even just print out hiragana or katakana booklets and be familiar with the characters and how to write them.
I took 2 years so far of Japanese in high school and am planning on taking it again in my upcoming junior year.