If you're not enjoying yourself, then you must be doing something wrong. Even battle mongers can have their jollies, at least unless they are that picky about having ultra perfect mons, then you are better off with a simulator. Don't want to do that? Then what's your preference? We've got Contests, Secret Bases, and Amie. There aren't a lot of rematches anymore, but they're still there if you want them. If you're really feeling bored, you can always start over with a new batch of pokes. If you're burnt out, then by all means, do something else. It doesn't make you less of a fan.
The only real issue I see is if you have a problem with Pokemon itself. Indeed this is not the franchise to seek for difficulty, not even from the spinoffs. If you don't like RPGs, puzzle games, or even pinball, there isn't anything I can recommend to you. We have the lightest TCG environment I'm aware of, but beware, they, like all TCG communities, are still highly competitive. Beyond the games, you either have the anime, manga, or the fan works community. If you can't deal with any of that, then yes, pokemon is not for you.