>>38814776I don't think there's a point in saving fp32 when it's training in 16 internally. And training in fp32 is probably much slower and needs more vram.
Though i don't really know myself. I'm just experimenting for fun. If i merge this model with anything or nutmeg it should work fine
>>38814415Something like this. Wait for Faunanon to come and do it properly
