>>80429305> training the Layer Norm and Group NormThat's what i did. Linked the wrong comment by mistake
>>80429203It's easy if you use Lycoris:
use --network_args "train_norm=True" in options,
and add "LayerNorm" to "text_encoder_target_module" in your preset or in venv\Lib\site-packages\lycoris\
config.pySDXL lora with full preset and all norm layers should show:
>INFO: create LyCORIS for Text Encoder: 354 modules.>INFO: module type table: {'LoConModule': 1052, 'NormModule': 345}