Another day of testing, running samplers and scheduler along with redoing and the workflow so it now auto splits the sigma at the right steps. Pretty much just set the steps for said listed schedulers I've put and your good to go or leave it to what I had set already. I've put some notes to help explain some stuff, over all should end up getting much more stable gens.
https://files.catbox.moe/ap0t7q.jsonI'll also include my own personal one that has RTtensor nodes which cuts down upscale and interpolation by around 70% however you will need to install everything for this and won't really work out of the box.
https://files.catbox.moe/0tb4e0.jsonhttps://github.com/yuvraj108c/ComfyUI-Upscaler-Tensorrthttps://github.com/yuvraj108c/ComfyUI-Rife-Tensorrt