IOI

Dataset Release: Indirect Object Identification mecha_ioi is a pair of datasets tailored for the Indirect Object Identification task, where sentences are generated from the following set of templates: BABA baba_templates = [ "Then, {B} and {A} went to the {PLACE}. {B} gave a {OBJECT} to {A}", "Then, {B} and {A} had a l

Papers using IOI (3)

AetherCode: Evaluating LLMs' Ability to Win In Premier Programming Competitions2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?2025AetherCode: Evaluating LLMs' Ability to Win In Premier Programming Competitions2025