IFEval

Dataset Card for IFEval Dataset Summary This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" such as "write in more than 400 words" and "mention the keyword of AI at least 3 times" which can be verified by

Papers using IFEval (12)

PaTaRM: Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling2025 · 4 citesThe Price of Format: Diversity Collapse in LLMs2025 · 2 citesBoosting Large Language Models with Mask Fine-Tuning2025Revisiting the Reliability of Language Models in Instruction-Following2025Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language Models2025Sample, Don't Search: Rethinking Test-Time Alignment for Language Models2025MM-IFEngine: Towards Multimodal Instruction Following2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models2025IFDECORATOR: Wrapping Instruction Following Reinforcement Learning with Verifiable Rewards2025Effectively Controlling Reasoning Models through Thinking Intervention2025M-IFEval: Multilingual Instruction-Following Evaluation2025Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following2024 · 4 cites