Tech
The Promptfoo Acquisition Made Me Realize I Was Evaluating LLMs on Easy Mode
In March 2026, OpenAI acquired Promptfoo — the tool that 350,000 developers use to evaluate and red-team OpenAI's own models.
I don't think that makes Promptfoo suddenly useless. But it made me ask a question I should have asked earlier: who is the eval tool accountable to?
Most LLM eval frameworks — DeepEval, Ragas, LangSmith — have something in common. They all route scoring through an LLM API call. That means your eval pipeline has at least three dependencies you don't control: the tool...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to