← all papers · overview

Idgen: Item Discrimination Induced Prompt Generation For LLM Evaluation

Abstract

As Large Language Models (LLMs) grow increasingly adept at managing complex tasks, the evaluation set must keep pace with these advancements to ensure it remains sufficiently discriminative. Item Discrimination (ID) theory, which is widely used in educational assessment, measures the ability of individual test items to differentiate between high and low performers. Inspired by this theory, we prop

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).