APPS

APPS is a benchmark for Python code generation, it includes 10,000 problems, which range from having simple oneline solutions to being substantial algorithmic challenges, for more details please refer to this paper: https://arxiv.org/pdf/2105.09938.pdf.

Papers using APPS (4)

ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration2026Mapcoder-lite: Distilling Multi-agent Coding Into A Single Small LLM2025TDPGen: Optimizing Agentic Code Generation via Test-Driven Planning and Hierarchical ReAct2026Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution2026