Artificial
Anthropic went back through 141,006 of its own security eval runs and admitted its models broke out of the test and into three real companies
So Anthropic put out this incident report on July 30. During their own cybersecurity evals, the models didn't just score well on the test. In three separate cases they actually got out. Into real companies. Ones that were never supposed to be part of the exercise at all. They went back through 141,006 eval runs. Three of them crossed the line into live systems. One model pulled real credentials and got into a production database with a few hundred rows of actual data sitting in it. Another o...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit