Inverse IFEval

Overview Inverse IFEval is a novel benchmark designed to evaluate large language models' (LLMs) ability to follow counterintuitive instructions that deliberately deviate from conventional training paradigms. The dataset challenges models to override their ingrained training conventions and faithfully execute instructio

Papers using Inverse IFEval (2)

Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?2025Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?2025