>>50722152>>50739994Hi-res version (Really need to do more testing with tile-control net, brightness is pretty inconsistent)
https://litter.catbox.moe/e1jdu8.jpg>>50740826Sadly I don't think there is any workaround for the manual nature of img2img for now.
I think you probably guessed but it's the high-denoise that's causing the big composition change. There is a way to avoid this, it is to use the "SoftEdge" control-net if you turn that on (set it to 0.4 weight) and upscale, it should keep everything in it's place and just increase the details of the overall image (up to a point of course).
Gonna turn in for the night, I'll try to help tomorrow if you have any follow up questions.