Scalable And Effective Generative Information Retrieval

Abstract

Recent research has shown that transformer networks can be used as differentiable search indexes by representing each document as a sequences of document ID tokens. These generative retrieval models cast the retrieval problem to a document ID generation problem for each given query. Despite their elegant design, existing generative retrieval models only perform well on artificially-constructed and small-scale collections. This has led to serious skepticism in the research community on their real-world impact. This paper represents an important milestone in generative retrieval research by showing, for the first time, that generative retrieval models can be trained to perform effectively on large-scale standard retrieval benchmarks. For doing so, we propose RIPOR- an optimization framework for generative retrieval that can be adopted by any encoder-decoder architecture. RIPOR is designed based on two often-overlooked fundamental design considerations in generative retrieval. First, give

Stats

• citations24
• S2 citations—
• github stars0
• HF likes0
• heat score10.48
• arxiv keyzeng2023scalable

Related papers

• Generative Retrieval As Dense Retrieval (2023)0.00
• How Does Generative Retrieval Scale To Millions Of Passages? (2023)10.61
• Irgen: Generative Modeling For Image Retrieval (2023)7.16
• Does Generative Retrieval Overcome The Limitations Of Dense Retrieval? (2025)0.00
• Generative Retrieval Meets Multi-graded Relevance (2024)2.26
• Lightweight And Direct Document Relevance Optimization For Generative Information Retrieval (2025)4.52
• Generative Adversarial Nets For Information Retrieval: Fundamentals And Advances (2018)0.00
• Differentiable Geometric Indexing For End-to-end Generative Retrieval (2026)0.00