Deep Neural Networks For Query Expansion Using Word Embeddings

Abstract

Query expansion is a method for alleviating the vocabulary mismatch problem present in information retrieval tasks. Previous works have shown that terms selected for query expansion by traditional methods such as pseudo-relevance feedback are not always helpful to the retrieval process. In this paper, we show that this is also true for more recently proposed embedding-based query expansion methods. We then introduce an artificial neural network classifier to predict the usefulness of query expansion terms. This classifier uses term word embeddings as inputs. We perform experiments on four TREC newswire and web collections show that using terms selected by the classifier for expansion significantly improves retrieval performance when compared to competitive baselines. The results are also shown to be more robust than the baselines.

Stats

• citations34
• S2 citations—
• github stars0
• HF likes0
• heat score11.58
• arxiv keyimani2018deep

Related papers

• Query Expansion With Locally-trained Word Embeddings (2016)16.14
• CEQE: Contextualized Embeddings For Query Expansion (2021)10.35
• Text Embeddings For Retrieval From A Large Knowledge Base (2018)4.52
• A Multi-resolution Word Embedding For Document Retrieval From Large Unstructured Knowledge Bases (2019)0.00
• Evaluating The Impact Of Word Embeddings On Similarity Scoring In Practical Information Retrieval (2026)0.00
• Incorporating Query Term Independence Assumption For Efficient Retrieval And Ranking Using Deep Neural Networks (2019)0.00
• Evaluating Embedding Models And Pipeline Optimization For AI Search Quality (2025)0.00
• Cross Modal Retrieval With Querybank Normalisation (2021)14.06