Release #2 of /vt/'s very own youtube chat archiver, released exclusively on /#/. Last time I dumped this here it was in a very fresh state, so this new release fixed a lot of bugs and made the system overall perform better. I added some options that will help in the initial load, as well as some functions that will help update data.
>What is this?A fully functional application that orchestrates the archiving of chats through the use of open source applications, the main players being yt-dlp and chat_downloader. To improve performance, the processing is split out into a producer/consumer model utilizing Kafka. Pic related, it is the system context diagram of the system.
>v1.0.1: https://litter.catbox.moe/2ycqyc.zipExpires in three days, have fun anons!