Tech
The cache key that ignored the question
Two people asked a context compressor two completely different questions. It gave them the same answer. Not a similar answer — byte for byte the same 544 characters.
Here's what that looked like:
query="Fix the IntegrityError on commit" level=L0 -> 159 tok cache_hit=False
query="Explain the tax rounding TODO in compute_tax" level=L3 -> 159 tok cache_hit=True
identical output: yes (544 chars both)
Different question. Different compression level. Same 544 charact...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to