Improving Neural Ranking Models With Traditional IR Methods

Abstract

Neural ranking methods based on large transformer models have recently gained significant attention in the information retrieval community, and have been adopted by major commercial solutions. Nevertheless, they are computationally expensive to create, and require a great deal of labeled data for specialized corpora. In this paper, we explore a low resource alternative which is a bag-of-embedding model for document retrieval and find that it is competitive with large transformer models fine tuned on information retrieval tasks. Our results show that a simple combination of TF-IDF, a traditional keyword matching method, with a shallow embedding model provides a low cost path to compete well with the performance of complex neural ranking models on 3 datasets. Furthermore, adding TF-IDF measures improves the performance of large-scale fine tuned models on these tasks.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysaha2023improving

Related papers

• A Deep Look Into Neural Ranking Models For Information Retrieval (2019)17.73
• Neural Models For Information Retrieval (2017)0.00
• Incorporating Query Term Independence Assumption For Efficient Retrieval And Ranking Using Deep Neural Networks (2019)0.00
• Neural Ranking Models For Document Retrieval (2021)11.08
• Neural IR Meets Graph Embedding: A Ranking Model For Product Search (2019)11.85
• Efficient Neural Ranking Using Forward Indexes (2021)8.82
• Efficient Neural Ranking Using Forward Indexes And Lightweight Encoders (2023)5.24
• On The Effect Of Low-frequency Terms On Neural-ir Models (2019)9.76