Quoted By:
We all laugh at the latency schizopost, but I often think of how I would solve problems vedal encounters If I were a shitdev, and most of my solutions involve additional operations, many of which would involve another pass through one or more LLM's, which is very expensive, latency-wise. Whenever vedal finds a way to combine steps, It is actually pretty impressive, and why he is so autistic about the latency.
The real crazy thing is that in a human brain, neurons take several milliseconds to fire. So for actions that you do that take less than a second, only something on the order of 100 neuron "operations/steps" have happened. This is completely mind boggling to me and I think about it a lot.
Idk if any techbros are even left here, but thank you for reading my schizo blog.
