A Few Brief Notes On Deepimpact, COIL, And A Conceptual Framework For Information Retrieval Techniques

Abstract

Recent developments in representational learning for information retrieval can be organized in a conceptual framework that establishes two pairs of contrasts: sparse vs. dense representations and unsupervised vs. learned representations. Sparse learned representations can further be decomposed into expansion and term weighting components. This framework allows us to understand the relationship between recently proposed techniques such as DPR, ANCE, DeepCT, DeepImpact, and COIL, and furthermore, gaps revealed by our analysis point to "low hanging fruit" in terms of techniques that have yet to be explored. We present a novel technique dubbed "uniCOIL", a simple extension of COIL that achieves to our knowledge the current state-of-the-art in sparse retrieval on the popular MS MARCO passage ranking dataset. Our implementation using the Anserini IR toolkit is built on the Lucene search library and thus fully compatible with standard inverted indexes.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylin2021a

Related papers

• Deeperimpact: Optimizing Sparse Learned Index Structures (2024)0.00
• Neural Information Retrieval: A Literature Review (2016)0.00
• Unsupervised Dense Information Retrieval With Contrastive Learning (2021)0.00
• A Deep Look Into Neural Ranking Models For Information Retrieval (2019)17.73
• End-to-end Retrieval With Learned Dense And Sparse Representations Using Lucene (2023)0.00
• Corect: A Framework For Evaluating Embedding Compression Techniques At Scale (2025)0.00
• Neural Models For Information Retrieval (2017)0.00
• SEINE: Segment-based Indexing For Neural Information Retrieval (2023)0.00