holy shit guys, HuggingFace (a Python ML site) has UL2, the model that outperformed GPT-3 despite having way less parameters.
https://huggingface.co/google/ul2It'll probably time out on you if you try interacting with it on the site, but any anons experienced in this sort of stuff could use the library and hook it up to Colab for something. I'm trying to see if it's doable on a free Colab account myself. Keep Your Smile, everyone.