>>79489598Sorry, Local idiot here. I went AWOL because I have been playing around with Gemma 2 for the past 2 days, sorry. It's now SOTA displacing L3 after a 2 month reign, man. Who knew Google's billions was good for anything, but most likely, that's because people poked Google enough and they brought out their big guns via DeepMind (The AlphaGo people) to drive this. Only issue is shit is still super unstable and minor things are broken or missing affecting performance. But yeah, the 9B size beats out L3 8B easily and is also multi-lingual too. 27B is looking like a bit worse than L3 70B at half the size. 4k context too because the sliding window thingy to make it 8k isn't implemented/broken. But overall, where it works, it works well. Needs RP tune ASAP, this thing is creative even with normal prompts and really little slop. Pic related.
