Tech
Every text-to-SQL benchmark score you've seen was measured without access control
Spider, BIRD, LiveSQLBench. If you have evaluated a text-to-SQL system in the
last five years you have quoted a number from one of them. All three ask the
same question: given a schema and an English question, does the system
produce SQL that returns the right rows?
None of them ask who is asking.
Every score you have seen was produced by a system with unrestricted read
access to the entire database. That is not how anyone runs one in production,
and a paper accepted to SIGMOD 2027 ha...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to