High-end Pokémon collectors are buying large quantities of Pokémon Sword to artificially inflate sales numbers. They are doing this to protect the value of their collections; as declining sales = decreasing relevance of the franchise = demand declines = high-end prices decline.

That's why Sword & Shield "broke sales records". Because some shady shit is going on.