MATH-500

Dataset Card for MATH-500 This dataset contains a subset of 500 problems from the MATH benchmark that OpenAI created in their Let's Verify Step by Step paper. See their GitHub repo for the source file: https://github.com/openai/prm800k/tree/main?tab=readme-ov-file#math-splits

Papers using MATH-500 (2)

DistillGuard: Evaluating Defenses Against LLM Knowledge Distillation2026BadThink: Triggered Overthinking Attacks on Chain-of-Thought Reasoning in Large Language Models2025