>>73793900>>73875731Cute!
>>73875775Hmm never tested this before but I train on both adam and prodigy (depending whether I am training on colab or not) but the LoRA I had most trouble with asymmetry was an adam one. I'll give it a try on my prodigy settings see if that works better.