HotpotQA

Dataset Card for BEIR Benchmark hotpotqa is one of the datasets from the Question Answering task within BEIR, measuring Wikipedia article retrieval for a given multi-hop query. Dataset Summary BEIR is a heterogeneous benchmark built from 18 diverse datasets representing 9 information retrieval tasks. Fact-checking: FEV

Papers using HotpotQA (27)

Retrieval as Reasoning: Self-Evolving Agent-Native Retrieval via LLM-Wiki2026Benchmarking Prompt Sensitivity in Large Language Models2025 · 2 citesKnowledge Graph-Guided Retrieval Augmented Generation2025 · 2 citesThe Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management2026H$^{2}$MT: Semantic Hierarchy-Aware Hierarchical Memory Transformer2026When Do LLM Agents Treat Surface Noise Differently from Semantic Noise? A 68-Cell Measurement Study with a Held-Out Trace-Level Validation2026PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agents2026NAACL: Noise-AwAre Verbal Confidence Calibration for LLMs in RAG Systems2026PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents2026One Token per Multimodal Evidence: Latent Memory for Resource-Constrained QA2026Calibrating LLMs with Semantic-level Reward2026Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agents2026COMI: Coarse-to-fine Context Compression via Marginal Information Gain2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents2026NOVA: NOise-aware Verbal Confidence CAlibration for Robust Large Language Models in RAG Systems2026Reevaluating Self-Consistency Scaling in Multi-Agent Systems2025A State-Update Prompting Strategy for Efficient and Robust Multi-turn Dialogue2025EAPO: Enhancing Policy Optimization with On-Demand Expert Assistance2025Open Data Synthesis For Deep Research2025Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Models2025MacRAG: Compress, Slice, and Scale-up for Multi-Scale Adaptive Context RAG2025Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation2025A Training-free LLM Framework with Interaction between Contextually Related Subtasks in Solving Complex Tasks2025Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception2025EDGE: Efficient Data Selection for LLM Agents via Guideline Effectiveness2025LLMQuoter: Enhancing RAG Capabilities Through Efficient Quote Extraction From Large Contexts2025Inference Scaling for Bridging Retrieval and Augmented Generation2024