Artificial
how do you actually manage a long chat before the model starts losing the plot?
been thinking about context windows lately. the advertised size keeps going up but in practice i still notice models getting vaguer or dropping details well before they should, especially stuff from the middle of a long thread. what i do right now is pretty crude: every so often i paste a short recap of the important bits so the thing it needs is near the end where it actually pays attention. works ok but feels like a workaround. curious what everyone else does. do you start fresh chats ofte...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit