If my mouse isn't moved for a minute or so, the fps on the game drops to like 5 or something. Games usually run at 70+. Happens in just about everything I play including Assetto corsa, Dark souls 3, destiny 2, and subnautica. In the case of Assetto Corsa, it happens while I'm playing, too (I use my wheel).

Specs
Win 10
16gb ram
GeForce GTX 970
intel i7-6700k

Games are up to date, graphics drivers are up to date. Any help at all would be greatly appreciated. Thank you