Reddit
I built a benchmark for multi-turn prompt injection attacks. Most defenses never see them coming.
Most prompt injection benchmarks currently operate on a one-shot basis. In these tests, an attack instructs the model to "ignore your instructions," and the defense either detects this violation or fails to do so. In reality, however, attacks often unfold more gradually. A model may be subtly influenced over the course of several interactions. For instance, an initial suggestion on a webpage can be reinforced by a follow-up email or reframed through tool outputs. By the time you reach ...










![An audiovisual technique I've been working on - [and made it open-source]](https://external-preview.redd.it/c3c1M3pvYW1qOGFoMSYxCluP7zCOld3DFte3VhUDHF5Ij2dUpdBo_NpiqYtW.png?width=640&crop=smart&auto=webp&s=1f49bdf980fda5fb857b35f998aff10d5a60d5f5)


