HumanEvalPack

Dataset Card for HumanEvalPack Dataset Summary HumanEvalPack is an extension of OpenAI's HumanEval to cover 6 total languages across 3 tasks. The Python split is exactly the same as OpenAI's Python HumanEval. The other splits are translated by humans (similar to HumanEval-X but with additional cleaning, see here). Refe

Papers using HumanEvalPack (4)

Summary-Mediated Repair: Can LLMs use code summarisation as a tool for program repair?2025Assessing Small Language Models for Code Generation: An Empirical Study with Benchmarks2025OctoPack: Instruction Tuning Code Large Language Models2023 · 16 citesOctoPack: Instruction Tuning Code Large Language Models2023 · 16 cites