I'm a sub kinda girl myself. I will admit that there are some pretty talented English-speaking voice actors, the best example coming from FLCL. There is hardly a voice in that show that doesn't match the character that they are playing. However, in certain anime, such as Nerima Daikon Brothers, it is best to stick with the Japanese audio because it is more fluid and you don't lose any jokes or cultural references simply because they don't know how to make it fit for the English ear. It seems to me that sticking with the way it was intended for audiences origionally is the best way to hear it.
I have to say though, it is pretty funny to hear bad voice-overs.