Quoted By:
Been playing around with local again lately. It turns out you can fit a 20b model on 10gb vram and 32gb ram. Obviously its offloading only some of the model to the gpu for speed but was getting tons of crashes before. Driver update may have helped? Etcetera