Why did they remove so much player agency after GSC? With each new game after this, they slowly started to force the player to visit areas of interest in a particular order. Why? Did Game Freak not understand that creating your own path = fun?

I get that SV is open world, but it feels too little too late at this point. Why did we have to go 6 whole generations being forced down narrower and narrower hallways?