BigCodeBench

BigCodeBench is a dataset/benchmark used to evaluate the effectiveness of adversarial attack selection in code by allowing red teams to create attack policies that attempt to insert attacks into code without detection by a monitor.

Papers using BigCodeBench (1)

Attack Selection Reduces Safety in Concentrated AI Control Settings against Trusted Monitoring2026