Improving Query Representations For Dense Retrieval With Pseudo Relevance Feedback
2021 · Hongchien Yu, Chenyan Xiong, Jamie Callan
Abstract
Dense retrieval systems conduct first-stage retrieval using embedded representations and simple similarity metrics to match a query to documents. Its effectiveness depends on encoded embeddings to capture the semantics of queries and documents, a challenging task due to the shortness and ambiguity of search queries. This paper proposes ANCE-PRF, a new query encoder that uses pseudo relevance feedback (PRF) to improve query representations for dense retrieval. ANCE-PRF uses a BERT encoder that consumes the query and the top retrieved documents from a dense retrieval model, ANCE, and it learns to produce better query embeddings directly from relevance labels. It also keeps the document index unchanged to reduce overhead. ANCE-PRF significantly outperforms ANCE and other recent dense retrieval systems on several datasets. Analysis shows that the PRF encoder effectively captures the relevant and complementary information from PRF documents, while ignoring the noise with its learned attenti
Authors
(none)
Tags
Stats
Related papers
- Improving Query Representations For Dense Retrieval With Pseudo Relevance Feedback: A Reproducibility Study (2021)7.16
- Pseudo-relevance Feedback For Multiple Representation Dense Retrieval (2021)12.93
- Improving Document Representations By Generating Pseudo Query Embeddings For Dense Retrieval (2021)9.41
- A Deep Learning Approach For Selective Relevance Feedback (2024)6.34
- TPRF: A Transformer-based Pseudo-relevance Feedback Model For Efficient And Effective Retrieval (2024)0.00
- Pseudo Relevance Feedback Is Enough To Close The Gap Between Small And Large Dense Retrieval Models (2025)0.00
- Augmenting Document Representations For Dense Retrieval With Interpolation And Perturbation (2022)5.84
- Query Encoder Distillation Via Embedding Alignment Is A Strong Baseline Method To Boost Dense Retriever Online Efficiency (2023)0.00