← all papers · overview

States Hidden In Hidden States: Llms Emerge Discrete State Representations Implicitly

Abstract

Large Language Models (LLMs) exhibit various emergent abilities. Among these abilities, some might reveal the internal working mechanisms of models. In this paper, we uncover a novel emergent capability in models: the intrinsic ability to perform extended sequences of calculations without relying on chain-of-thought step-by-step solutions. Remarkably, the most advanced models can directly output t

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).