Yea, for some things I have problems too, both my IME and my Japanese WP don't co-operate too much
ず is one of those, I am not able to write つ with ". Just like when I write in katakana I am not able to write the small letters (like for the word party).