>>5753240I keep my wallpapers, because I often come back to one I used before. Or I use more than one in a cycle. Sometimes, when I play a game excessively, for example Mass Effect, I'll have about 70 related wallpapers cycle through the days and weeks I play this game. And I'll keep them, because I know, I will play the game again.
Also, if you have more than a terrabyte HDD, you'll have more than enough space to keep them. I also use them for other devices, like my phone or my tablet.