Tech
Persistent memory for Ollama, in about five minutes
Originally published on the Sieve blog . Sieve is an open-source (Apache 2.0) context-reduction proxy β I work on it. This is a how-to, not a pitch; the steps work against any Ollama setup.
Ollama gives you a local LLM endpoint that is fast, private, and completely stateless. Close the chat, and everything you told the model is gone. Keep the chat open, and every turn re-sends a growing history until the context window fills up. Ask a local model about something it was never told, and β d...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to