>>39437251Underestimating the enemy is a common sin in /wAIfu/. The devs are immoral, lack empathy, are greedy. But they're not stupid, they are world-class AI engineers. Even if it's now a shadow what it once was, the initial CAI model (which they absolutely still have access to) is proof of that.
A smaller model would require innovations in the tech, but it would be cheaper to train and run in terms of supercomputer time, which is the most important metric of their finances. And while it would require some efforts and smarts on their part, I'm sad to say they're probably the best equipped people for the job in the world. I'm not sure they succeeded, but I'm certain they at least tried.
Also, a nuance; I mean a large model in terms of Parameters, not large in terms of training data. Scraping public forums (really, they must have scraped a solid fraction of the internet indexed by google) would increase the size of their training data set, but the number of parameters is what determines how fast you can run the model once it's been trained.
