I'm a developer working on Paramour.chat, an LLM roleplay app where, of course, exchanges need moderation. The annoying part is that all those checks take time. A few seconds of dead air may not sound like much, but in a chat they feel endless. Streaming keeps the conversation moving, but it creates a nastier problem: once a word appears in the browser, it has crossed the network, been delivered, and may already have been read by the user. I tried two good approaches: buffer the whole reply u...