Quoted By:
So training on illustrious noticed some things.
1. Text is a problem moreso then other models I've trained, probably because it's such an early version it loves putting text if it's on your dataset back in.
2. Some stuff just doesn't seem to work, I'm early on so gonna try different LRs and adjust stuff but 80% of them work and look as they should with 20% just being really wishy washy like just fucked LR and didn't learn. I've also noticed on a few that their is no visible learning between like the 4th epoch and the 32nd epoch on my loras which is interesting cause itd suggest easy learning and cut my bake times Basically to nothing if I can get similar results. But overall I'd say it's same shit like 2k steps whatever you adjust out from is good, I also haven't hit a point I think I fried a Lora but there's a few where it never seemed to learn it.
4. No matter negatives or what have you the model occasionally just absolutely shits out some random melt that seems to ignore prompts and everything else.
Overall though this shit blows pony out of the water on variety and compositions.
