>>57906381>give it a few more yearsExactly. By the time you amortise a 3090 at datacenter usage pricing, you're looking at buying 6090s and 7090s. It's literally six years until you're ahead from buying rather than renting, and all the while, I'll have access to business level cards and a superior experience.
Again, electricity excluded, (if you're in Europe you're always behind economically)
It just doesn't make any sense to run local, even free colab accounts can run 13b models at lightning speeds, and 70b models are behind a 10 bucks a month subscription.
Worst case scenario, individually renting instead of using a subscription service like chub venus or colab, you're looking at a buck an hour. 70b open source models are within our sight fellas.
We're all gonna make it.
