AutoCodeBench-Lite

AutoCodeBench-Lite is a large-scale code generation benchmark containing 3,920 problems evenly distributed across 20 programming languages, used to evaluate the code generation capabilities of large language models.

Papers using AutoCodeBench-Lite (2)

AutoCodeBench: Large Language Models are Automatic Code Benchmark Generators2025AutoCodeBench: Large Language Models are Automatic Code Benchmark Generators2025