← all papers · overview

Brittlebench: Quantifying LLM Robustness Via Prompt Sensitivity

Abstract

Existing evaluation methods largely rely on clean, static benchmarks, which can overestimate true model performance by failing to capture the noise and variability inherent in real-world user inputs. This is especially true for language models, which can face human-generated text queries containing mistakes, typos, or alternative ways of phrasing the same question. In this work, we introduce a the

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).