GSM8K

GSM8K is a benchmark dataset that contains mathematical reasoning problems used to evaluate the performance of language models on complex reasoning tasks.

Papers using GSM8K (37)

Pay for Hints, Not Answers: LLM Shepherding for Cost-Efficient Inference2026Shape of Thought: When Distribution Matters More than Correctness in Reasoning Tasks2025Rewriting Pre-Training Data Boosts LLM Performance in Math and Code2025Reasoning-as-Logic-Units: Scaling Test-Time Reasoning in Large Language Models Through Logic Unit Alignment2025MathClean: A Benchmark for Synthetic Mathematical Data Cleaning2025PAL: Program-aided Language Models2022 · 104 citesProgressive-Hint Prompting Improves Reasoning in Large Language Models2023 · 33 citesMetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models2023 · 28 citesOrca-Math: Unlocking the potential of SLMs in Grade School Math2024 · 7 citesLearning From Mistakes Makes LLM Better Reasoner2023 · 5 citesMathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning2023 · 4 citesOpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset2024 · 3 citesDotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning2024 · 3 citesInternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning2024 · 3 citesAutomatic Model Selection with Large Language Models for Reasoning2023 · 2 citesMathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs2024 · 2 citesMuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning2024 · 2 citesLogicPro: Improving Complex Logical Reasoning via Program-Guided Learning2024 · 1 citesPMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning2024 · 1 citesTinyGSM: achieving >80% on GSM8k with small language models2023 · 1 citesBuilding Math Agents with Multi-Turn Iterative Preference Learning2024 · 1 citesExplicit Knowledge Transfer for Weakly-Supervised Code Generation2022Exploring Equation as a Better Intermediate Meaning Representation for Numerical Reasoning2023AskIt: Unified Programming Interface for Programming with Large Language Models2023MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible Pipeline2024Prompt Selection and Augmentation for Few Examples Code Generation in Large Language Model and its Application in Robotics Control2024Can LLMs Reason in the Wild with Programs?2024Not All Votes Count! Programs as Verifiers Improve Self-Consistency of Language Models for Math Reasoning2024Can Large Language Models Invent Algorithms to Improve Themselves?: Algorithm Discovery for Recursive Self-Improvement through Reinforcement Learning2024ReasonAgain: Using Extractable Symbolic Programs to Evaluate Mathematical Reasoning2024UTMath: Math Evaluation with Unit Test via Reasoning-to-Coding Thoughts2024InfinityMATH: A Scalable Instruction Tuning Dataset in Programmatic Mathematical Reasoning2024MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning2023OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset2024Orca-Math: Unlocking the potential of SLMs in Grade School Math2024DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning2024InfinityMATH: A Scalable Instruction Tuning Dataset in Programmatic Mathematical Reasoning2024