CodeMixBench

BigCodeBench-CodeMixed Dataset Description This dataset is an augmented version of BigCodeBench designed for evaluating code generation in code-mixed scenarios. It introduces multilingual variations of the prompts, primarily focusing on translating the docstrings within the complete_prompt field while keeping the code

Papers using CodeMixBench (2)

CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages2025CodeMixBench: Evaluating Large Language Models on Code Generation with Code-Mixed Prompts2025