I have over 50 hours logged in and only have 4 badges (too much breeding and fishing and shit), and I'm actually feeling a little burned out. Now Lumiose is open and has a gazillion fucking cafes and buildings and shit. Is it worth visiting them all?

Normally I'm all for exploring but I'm a little tired of fucking around. Can I just beat the gym and advance the plot without missing too much?