Beyond Precision: A Study On Recall Of Initial Retrieval With Neural Representations

Abstract

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural representations have shown great success in capturing semantic relatedness, leading to new possibilities to alleviate the vocabulary mismatch problem in IR. However, most existing efforts in this direction have been devoted to the re-ranking stage. That is to leverage neural representations to help re-rank a set of candidate documents, which are typically obtained from an initial retrieval stage based on some symbolic index and search scheme (e.g., BM25 over the inverted index). This naturally raises a question: if the relevant documents have not been found in the initial retrieval stage due to vocabulary mismatch, there would be no chance to re-rank them to the top positions later. Therefore, in this paper, we study the problem how to employ neural representations to improve the recall of relevant documents in the

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyxiao2018beyond

Related papers

• SEINE: Segment-based Indexing For Neural Information Retrieval (2023)0.00
• Neural Information Retrieval: A Literature Review (2016)0.00
• Neural Models For Information Retrieval (2017)0.00
• On The Effect Of Low-frequency Terms On Neural-ir Models (2019)9.76
• A Deep Look Into Neural Ranking Models For Information Retrieval (2019)17.73
• Incorporating Query Term Independence Assumption For Efficient Retrieval And Ranking Using Deep Neural Networks (2019)0.00
• Semantic Models For The First-stage Retrieval: A Comprehensive Review (2021)14.27
• Pseudo-relevance Feedback For Multiple Representation Dense Retrieval (2021)12.93