Annoying, sure.
Having to put faith in a random person to translate for you, for the sake of watching a cartoon is pretty annoying, also. Also, the cultural and traditional nuances fly over my head. Absolutely. But, it can still be enjoyable.
Do you not have a foreign show that you enjoy that you do not fully "understand"?