MMLU-Pro-X

MMLU-ProX MMLU-ProX is a multilingual benchmark that builds upon MMLU-Pro, extending to 29 typologically diverse languages, designed to evaluate large language models' reasoning capabilities across linguistic and cultural boundaries. Github | Paper News [2025/08] 🎉 MMLU-ProX was accepted by EMNLP 2025 Main Conference!

Papers using MMLU-Pro-X (3)

Extending Item Response Theory for Efficient and Meaningful Multilingual Evaluation2026COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Sampling2026MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation2025