>>58002728 (me)>>58002661Yeah download one of the GGUF files and drag and drop that onto the exe. That should work.
As for which one...
mythalion-13b.Q2_K.gguf Q2_K 2 5.43 GB 7.93 GB smallest, significant quality loss - not recommended for most purposes
mythalion-13b.Q3_K_S.gguf Q3_K_S 3 5.66 GB 8.16 GB very small, high quality loss
mythalion-13b.Q3_K_M.gguf Q3_K_M 3 6.34 GB 8.84 GB very small, high quality loss
mythalion-13b.Q3_K_L.gguf Q3_K_L 3 6.93 GB 9.43 GB small, substantial quality loss
mythalion-13b.Q4_0.gguf Q4_0 4 7.37 GB 9.87 GB legacy; small, very high quality loss - prefer using Q3_K_M
mythalion-13b.Q4_K_S.gguf Q4_K_S 4 7.41 GB 9.91 GB small, greater quality loss
mythalion-13b.Q4_K_M.gguf Q4_K_M 4 7.87 GB 10.37 GB medium, balanced quality - recommended
mythalion-13b.Q5_0.gguf Q5_0 5 8.97 GB 11.47 GB legacy; medium, balanced quality - prefer using Q4_K_M
mythalion-13b.Q5_K_S.gguf Q5_K_S 5 8.97 GB 11.47 GB large, low quality loss - recommended
mythalion-13b.Q5_K_M.gguf Q5_K_M 5 9.23 GB 11.73 GB large, very low quality loss - recommended
mythalion-13b.Q6_K.gguf Q6_K 6
10.68 GB 13.18 GB very large, extremely low quality loss
mythalion-13b.Q8_0.gguf Q8_0 8 13.83 GB 16.33 GB very large, extremely low quality loss - not recommended
Now go pick some T-Doll cards and hold hands with them.
