>>66061037I ended up using a different model and VAE and a lot of inpainting. Stayed with the attention based setting. Haven't messed with ADDBASE yet. I made a lot of little tweaks but I'm honestly not sure what was different.
https://files.catbox.moe/pkop6p.pngCatbox for reference.