SHADE-Arena

SHADE-Arena is a benchmark dataset containing ten task domains used to evaluate the effectiveness of monitoring frameworks like TRACE in detecting malicious objectives in long-horizon trajectories of autonomous LLM agents.

Papers using SHADE-Arena (2)

Agent-ToM: Learning to Monitor Autonomous LLM Agents via Theory-of-Mind Reasoning2026TRACE: Trajectory Reasoning through Adaptive Cross-Step Evidence Aggregation for LLM Agents2026