GPQA

Dataset Card for GPQA GPQA is a multiple-choice, Q&A dataset of very hard questions written and validated by experts in biology, physics, and chemistry. When attempting questions out of their own domain (e.g., a physicist answers a chemistry question), these experts get only 34% accuracy, despite spending >30m with ful

Papers using GPQA (10)

SePO: Self-Evolving Prompt Agent for System Prompt Optimization2026PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solving2025 · 4 citesDecision Protocols in Multi-Agent Large Language Model Conversations2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning2026Learning to Orchestrate Agents in Natural Language with the Conductor2025AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence2026Graph-of-Agents: A Graph-based Framework for Multi-Agent LLM Collaboration2026Polaris: A G\"odel Agent Framework for Small Language Models through Experience-Abstracted Policy Repair2026FlowSearch: Advancing deep research with dynamic structured knowledge flow2025P3: Prompts Promote Prompting2025