← all papers · overview

Language Models Do Hard Arithmetic Tasks Easily And Hardly Do Easy Arithmetic Tasks

Abstract

The ability (and inability) of large language models (LLMs) to perform arithmetic tasks has been the subject of much theoretical and practical debate. We show that LLMs are frequently able to correctly and confidently predict the first digit of n-digit by m-digit multiplication tasks without using chain of thought reasoning, despite these tasks require compounding operations to solve. Simultaneous

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).