Quoted By:
DoRa in Lycoris really works now. Looks slightly better than normal lora, but trains 10-20% slower
I used --network_module lycoris.kohya --network_dim=32 --network_alpha=16 --network_args "algo=lora" "dora_wd=True" "preset=unet-transformer-only" "module_dropout=0.05"
The rest of the settings are the same as for Lora.