do I seriously need to bother with IVs if I want to ever beat any of the battle facilities in the games?

I just want to beat the battle tower/maison/tree master whatever, get that sweet trainer card upgrade and move on
but christ I can never even reach the guy even with EV trained mons I got straight out of a smogon guide
am I just unlucky or are perfect IVs mandatory?