Tech
Your RAG copilot can't count — stop letting it try
Your RAG copilot can't count — stop letting it try
A user asked our document-search copilot a completely reasonable question: how many documents a specific person authored. The copilot answered with a number. Confidently. With a nice sentence around it.
The real answer, computed by the database, was 84 . The copilot said — because it did what every RAG system does when you ask it an aggregation question: it counted what it could see.
Here's the claim I want to defend, because I think ...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to