>>41792210I was gonna do you a favour and download all the pruned models from your grug huggingface and do a huge xy plot comparing all the hll variants once we solidify what we got here.
Why I am like this? Sorry I dont understand.>>41792350I dont think pruning intermediate products is worthwhile. It should only be done on the final step. The merge process itself will bump the model size up and doing a prune step inbetween feels detrimental even if the weights are close to 0.
