BigCodeBench

Papers using BigCodeBench (33)

A Survey on Large Language Models for Code Generation2024 · 56 citesKodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding2025 · 4 citesFLARE: Fine-Grained Diagnostic Feedback for LLM Code Refinement2026Conv-to-Bench: Evaluating Language Models Via User-Assistant Dialogues In Code Tasks2026Large Language Model Guided Self-Debugging Code Generation2025 · 2 citesEnhancing LLM-Based Code Generation with Complexity Metrics: A Feedback-Driven Approach2025 · 1 citesReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning2026Consistency Meets Verification: Enhancing Test Generation Quality in Large Language Models Without Ground-Truth Solutions2026NOIR: Privacy-Preserving Generation of Code with Open-Source LLMs2026DAJ: Data-Reweighted LLM Judge for Test-Time Scaling in Code Generation2026FunPRM: Function-as-Step Process Reward Model with Meta Reward Correction for Code Generation2026InspectCoder: Dynamic Analysis-Enabled Self Repair through interactive LLM-Debugger Collaboration2025TALM: Dynamic Tree-Structured Multi-Agent Framework with Long-Term Memory for Scalable Code Generation2025Reinforcement Learning-Guided Chain-of-Draft for Token-Efficient Code Generation2025Alignment with Fill-In-the-Middle for Enhancing Code Generation2025IterPref: Focal Preference Learning for Code Generation via Iterative Debugging2025CodeMixBench: Evaluating Large Language Models on Code Generation with Code-Mixed Prompts2025OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs2025Teaching Your Models to Understand Code via Focal Preference Alignment2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding2025Memorize or Generalize? Evaluating LLM Code Generation with Code Rewriting2025Verbal Process Supervision Elicits Better Coding Agents2025ACECODER: Acing Coder RL via Automated Test-Case Synthesis2025UnitCoder: Scalable Iterative Code Synthesis with Unit Test Guidance2025BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions2024 · 15 citesTraining Language Models on Synthetic Edit Sequences Improves Code Synthesis2024 · 1 citesArctic-SnowCoder: Demystifying High-Quality Data in Code Pretraining2024DSTC: Direct Preference Learning with Only Self-Generated Tests and Code to Improve Code LMs2024Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretraining2024ACECODER: Acing Coder RL via Automated Test-Case Synthesis2025Large Language Model Guided Self-Debugging Code Generation2025Verbal Process Supervision Elicits Better Coding Agents2025ReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning2026