← all papers · overview

Assessing Code Understanding In Llms

Abstract

We present an empirical evaluation of Large Language Models in code understanding associated with non-trivial, semantic-preserving program transformations such as copy propagation or constant folding. Our findings show that LLMs fail to judge semantic equivalence in approximately 41% of cases when no context is provided and in 29% when given a simple generic context. To improve accuracy, we advoca

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).