WebApp-1K

WebApp-1K is a benchmark consisting of 1000 diverse challenges across 20 application domains, used to evaluate large language models (LLMs) in test-driven development (TDD) tasks by assessing their ability to generate functional code from test cases.

Papers using WebApp-1K (5)

Tests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation2025 · 1 citesTests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation2025 · 1 citesWebApp1K: A Practical Code-Generation Benchmark for Web App Development2024 · 1 citesInsights from Benchmarking Frontier Language Models on Web App Code Generation2024A Case Study of Web App Coding with OpenAI Reasoning Models2024