BigCodeBench

BigCodeBench The dataset has 2 variants: BigCodeBench-Complete: Code Completion based on the structured docstrings. BigCodeBench-Instruct: Code Generation based on the NL-oriented instructions. The overall statistics of the dataset are as follows: Complete Instruct # Task 1140 1140 # Avg. Test Cases 5.6 5.6 # Avg. Cove

Papers using BigCodeBench (6)

ACECODER: Acing Coder RL via Automated Test-Case Synthesis2025 · 3 citesReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning2026FunPRM: Function-as-Step Process Reward Model with Meta Reward Correction for Code Generation2026CosmoCore-Evo: Evolutionary Dream-Replay Reinforcement Learning for Adaptive Code Generation2025CosmoCore Affective Dream-Replay Reinforcement Learning for Code Generation2025Reinforcement Learning-Guided Chain-of-Draft for Token-Efficient Code Generation2025