A paper: When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift.
- A paper: When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift.
- Remember that prompt injection attacks are not a static distribution.
- They will coevolve as the attackers discover new effective attacks.
- The attackers aren't doing it for fun, they're doing it to achieve a goal, and their goal remains so they'll keep finding successful new attacks.
- A never-ending cat-and-mouse game.