Hot take Raw click stats are a powerful, production-friendly signal for LLM rerankers β€” but they can also make those rerankers lazy. Injecting CTR/QSS/Q-values into prompts yields big wins on head queries, yet models will often learn the shortcut "follow the clicks" instead of learning semantic relevance. That shortcut breaks badly on cold-start and long-tail queries. This article explains why that happens, surveys practical mitigations, and describes a production-friendly pattern I use: ...