Generative Retrieval As Multi-vector Dense Retrieval

Abstract

Generative retrieval generates identifiers of relevant documents in an end-to-end manner using a sequence-to-sequence architecture for a given query. The relation between generative retrieval and other retrieval methods, especially those based on matching within dense retrieval models, is not yet fully comprehended. Prior work has demonstrated that generative retrieval with atomic identifiers is equivalent to single-vector dense retrieval. Accordingly, generative retrieval exhibits behavior analogous to hierarchical search within a tree index in dense retrieval when using hierarchical semantic identifiers. However, prior work focuses solely on the retrieval stage without considering the deep interactions within the decoder of generative retrieval. In this paper, we fill this gap by demonstrating that generative retrieval and multi-vector dense retrieval share the same framework for measuring the relevance to a query of a document. Specifically, we examine the attention layer and pred

Stats

• citations13
• S2 citations—
• github stars0
• HF likes0
• heat score8.60
• arxiv keywu2024generative

Related papers

• Generative Retrieval As Dense Retrieval (2023)0.00
• Generative Retrieval Meets Multi-graded Relevance (2024)2.26
• Generative Dense Retrieval: Memory Can Be A Burden (2024)4.52
• Does Generative Retrieval Overcome The Limitations Of Dense Retrieval? (2025)0.00
• Hierarchical Corpus Encoder: Fusing Generative Retrieval And Dense Indices (2025)0.00
• Learning To Tokenize For Generative Retrieval (2023)4.52
• ASI++: Towards Distributionally Balanced End-to-end Generative Retrieval (2024)0.00
• Generative Recall, Dense Reranking: Learning Multi-view Semantic Ids For Efficient Text-to-video Retrieval (2026)0.00