I have an idea for a long range cross continent transportation

>hot air balloon
>fly high into the sky
>high enough to float in the stratosphere, turn off fuel
>don't move, it stays in a fixed place
>let the earth rotate below you
>float down 12 hours later
>you're on the other side of the globe

Tell me why this wouldn't work.
Flights from US to the far east (Tokyo / China / etc...) take 12+ hours anyway. So why not conserve fuel and let the earth's rotation do the work for you?