WebApp-1K

WebApp1K is a benchmark containing 1000 diverse challenges across 20 application domains, used to evaluate large language models (LLMs) in test-driven development (TDD) tasks by assessing their ability to generate functional code from test cases.

Papers using WebApp-1K (6)

Tests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation2025 · 1 citesTests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation2025 · 1 citesWebApp1K: A Practical Code-Generation Benchmark for Web App Development2024 · 1 citesInsights from Benchmarking Frontier Language Models on Web App Code Generation2024Insights from Benchmarking Frontier Language Models on Web App Code Generation2024A Case Study of Web App Coding with OpenAI Reasoning Models2024