>>91813810>Wait, 100 messages for 3 USD?Yeah, but I barely swiped during the whole chat. Plus, I think the biggest reason is that Claude wasn't cooking too much for some reason.
I was using 3.5, and most of the replies were between 250 and 500 tokens (according to ST's tokeniser at least), usually averaging ~450. I didn't think it was bad considering Claude's tendency towards cooking progressively longer novels with each reply, especially since I was the one paying it, but it only started writing more towards the ending (after I told him to do it in OOC) and the replies went to 700~800 tokens each.
>>91816430I also saw the Rentry about prompt caching but couldn't get it to work either. I changed both config files and also tried to add something to the author's note, and still nothing.
