GAIA

GAIA dataset GAIA is a benchmark which aims at evaluating next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc). We added gating to prevent bots from scraping the dataset. Please do not reshare the validation or test set in a crawlable format. Data and

Papers using GAIA (3)

Infantagent-next: A Multimodal Generalist Agent For Automated Computer Interaction2025MATRIX: Multimodal Agent Tuning For Robust Tool-use Reasoning2025GAIA: A Global, Multi-modal, Multi-scale Vision-Language Dataset for Remote Sensing Image Analysis2025