>>74037799I actually figured out like a split second after posting that the option for only transferring composition is under the weights dropdown
https://files.catbox.moe/3j7l9i.pngFurther testing also has made me realize that the "pov" of "pov doorway" was probably overpowering and confusing the composition, so going through the rigamarole of ipadapter/controlnet was useless but fun to experiment with
https://files.catbox.moe/fudb97.png