>>51348358you can use it no problem if you code
but just wait for the update
its a little more complicated than 2 steps because
holy fuck the codebase is a god damn modular mess
i had to do a janky mod because
>getTiktokenTokenizer(model)simply does NOT like playing nice with
>gpt-3.5-turbo-16kas an argument to it