Quick test of the new DAdaptAdanIP.
Very easy to use. No need to adjust parameters - it just works.
used dim 64, 250 images, 1800 steps, warmup 50 steps, lr 1.0, max_grad_norm 0.
1 - alpha 1, growth_rate 1.05
2 - alpha 1, growth_rate 1.5 - worst, consistently generates 3 hands
3 - alpha 64, growth_rate 2
4 - alpha 64, growth_rate 1.1, warmup 5 steps
Looks like best settings are same as in d-adapt adam - alpha=dim and growth_rate 1.05 - 1.1
Tried it with 20k images too - it still works.
https://litter.catbox.moe/rjm86e.jpg 