← all papers · overview

Pitfalls Of Scale: Investigating The Inverse Task Of Redefinition In Large Language Models

Abstract

Inverse tasks can uncover potential reasoning gaps as Large Language Models (LLMs) scale up. In this work, we explore the redefinition task, in which we assign alternative values to well-known physical constants and units of measure, prompting LLMs to respond accordingly. Our findings show that not only does model performance degrade with scale, but its false confidence also rises. Moreover, while

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).