>>87584156I don't work in the field unfortunately so I am not a definitive source but I am fairly grounded as a fair few of my friends and former coworkers do work in that field right now. Just to give you some more peace of mind and context. Even if it was possible to reach AGI with this, the costs are going to stop you before anything. Pic related is a chart someone made on how much it costs to train a model. It already costs 100m+ to train the latest models. At best, we have another singular magnitude increase in costs we can afford, going to 1-10 billion before you outstrip in training costs the GDP of the countries which can't afford it. Remember you have to pay staff and etc. too which is another bunch of money. The USA GDP per year is 20 trillion, there is only so much room you can scale and no country is going to convince its citizens that spending the entire year's budget on an LLM is worth it.
