HumanEval-CPP

HumanEval/MRI/C++ This is a multi-region infilling version of the C++ translation of HumanEval. It was generated by randomly removing between 1 and 3 spans from the canonical solution in the dataset. This dataset was used for evaluation in the paper Constrained Decoding of Diffusion LLMs with Context-Free Grammars. You

Papers using HumanEval-CPP (3)

Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models2025 · 6 citesHintPilot: LLM-based Compiler Hint Synthesis for Code Optimization2026SysLLMatic: Large Language Models are Software System Optimizers2025