>not one of the Matrix guys just reposting because if you want to escape CAI there is hopeOur regular post doesn't fit inside of 4chinz character limit kek. The full, extended version of the post with more details is here. Please read that:
https://rentry.org/f8pebMatrixfag here. We've set up a way for people to help build the data required to fine-tune larger models: a website in which chatlogs from CAI can be voluntarily submitted for the purposes of compiling a dataset. As said before, good data required to make a chatbot is hard to come by. With CAI logs, we can obtain a valuable resource to get Pygmalion-1.3B and beyond up and running.
The process required for sending data consists of two steps:
1. Scrape your CAI chatlogs and download it into a JSON file. This is done through our CAI dumper userscript, which can be found here:
https://git.fuwafuwa.moe/waifu-collective/toolbox/src/branch/master/extras/characterai-dumperBe sure to go through your logs and check to make sure all personal information is redacted. Pre-1.2 versions of the userscript may contain your CAI display name in the chatlogs due to a bug which was found only after it got out of the Matrix and put on /g/.
2. Go to
https://dump.nopanda.io/ and upload your JSON files of either chatlogs or bot definitions. Your data will be stored on a secure server and will not be touched until it is time to use them for fine-tuning.
We are also planning to build and release a public dataset of conversations for the purpose of aiding others who may be doing a project similar to ours. More details are in the extended post.
I realize that a post coming in and asking you to dump your data to a certain website may not be warmly recieved. Feel free to reply with any questions or concerns and I'll do my best to reply to you guys.
Thank you all for the support you showed for Pygmalion-350M's release! It blew our expectations out of the water and gave us a huge whitepill. A better future is coming, everyone. Just hold tight and keep your smile.
DUMPER WEBSITE:
https://dump.nopanda.io/USERSCRIPT & GUIDE:
https://git.fuwafuwa.moe/waifu-collective/toolbox/src/branch/master/extras/characterai-dumper 