← all papers · overview

Nlperturbator: Studying The Robustness Of Code Llms To Natural Language Variations

Abstract

Large language models (LLMs) achieve promising results in code generation based on a given natural language description. They have been integrated into open-source projects and commercial products to facilitate daily coding activities. The natural language description in the prompt is crucial for LLMs to comprehend users' requirements. Prior studies uncover that LLMs are sensitive to the changes i

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).