Omni-MATH

Dataset Card for Omni-MATH Recent advancements in AI, particularly in large language models (LLMs), have led to significant breakthroughs in mathematical reasoning capabilities. However, existing benchmarks like GSM8K or MATH are now being solved with high accuracy (e.g., OpenAI o1 achieves 94.8% on MATH dataset), indi

Papers using Omni-MATH (3)

Benchmarks Saturate When The Model Gets Smarter Than The Judge2026 · 1 citesDeeper is Not Always Better: Mitigating the Alignment Tax via Confident Layer Decoding2026The Relationship Between Reasoning and Performance in Large Language Models -- o3 (mini) Thinks Harder, Not Longer2025