Oh I made a little discovery (or at least I learned something I didn't know before) that I thought I should share with you guys.
Your vae won't change the overall lighting of an output in inpainting, but it will effect the individual parts you're inpainting and can mess things up. Take this Kronster I made a few days ago as an example.
https://files.catbox.moe/qjwmpt.pngI want to inpaint away the weird melty skin bits. So this is what happens if I inpaint the skin with clearvae active (the vae I used for the original output).
https://files.catbox.moe/3h9jjx.pnghttps://files.catbox.moe/v82ye0.pngThe replacement skin is weird and pink so it doesn't go at all. But if I switch my vae to anything vae...
https://files.catbox.moe/amns1k.pngAnd the skin blends just fine!
I don't know why that is but I figured I should point it out since it might be relevant if you're inpainting on a vae other than the novelai/anything vae.