SWE-bench-Live

A brand-new, continuously updated SWE-bench-like dataset powered by an automated curation pipeline. For the official data release page, please see microsoft/SWE-bench-Live. Dataset Summary SWE-bench-Live is a live benchmark for issue resolving, designed to evaluate an AI system’s ability to complete real-world software

Papers using SWE-bench-Live (5)

No Time Like the Present: Agentic Test-Time Training for LLM Agents2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills2026SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolution2025Code Graph Model (CGM): A Graph-Integrated Large Language Model for Repository-Level Software Engineering Tasks2025SWE-bench Goes Live!2025