>>1481460This.
Don't have a real explanation as to why, it just works. And it will stop shrinking at a certain point, so you can tumble dry it every fourth or fifth wash for softness.
As a child, my grandfather would insist on all fiber everywhere, and a giant cedar hat for himself. Wool for three seasons, linen for one.
Now I have bits and pieces of a wardrobe per season, but I rely on layering more than good material.