>>2802599The main speed tradeoff I know of is the --medvram and --lowvram options, which will reduce VRAM usage at the cost of making it much slower. VRAM really just correlates with how much you can do rather than speed directly.
I'm not aware of any speed hacks. Higher VRAM cards have faster clock speeds too, so they're gonna be faster in general.
I've heard that ComfyUI is faster due to a more efficient pipeline.