Makes enough sense I guess. In the real world, a lot of buildings with a purpose often have recognizable construction. While not being COMPLETELY the same, churches, schools, government buildings, things like that often have a stereotypical "look" associated with them, so it's not a stretch to think that in Kalos they have a "look" for pokemon gyms.
