← all datasets

CodeMMLU

Emerging
2papers using it
1,893HF downloads
7HF likes
2024first seen

CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding Capabilities 📌 CodeMMLU CodeMMLU is a comprehensive benchmark designed to evaluate the capabilities of large language models (LLMs) in coding and software knowledge. It builds upon the structure of multiple-choice question answering (MCQA) to cover a wi

🤗 Hugging Face⚖ mit

Papers using CodeMMLU (2)

CodeMMLU — datasets — ai-for-code