Improving Bert-based Query-by-document Retrieval With Multi-task Optimization

Abstract

Query-by-document (QBD) retrieval is an Information Retrieval task in which a seed document acts as the query and the goal is to retrieve related documents -- it is particular common in professional search tasks. In this work we improve the retrieval effectiveness of the BERT re-ranker, proposing an extension to its fine-tuning step to better exploit the context of queries. To this end, we use an additional document-level representation learning objective besides the ranking objective when fine-tuning the BERT re-ranker. Our experiments on two QBD retrieval benchmarks show that the proposed multi-task optimization significantly improves the ranking effectiveness without changing the BERT re-ranker or using additional training samples. In future work, the generalizability of our approach to other retrieval tasks should be further investigated.

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keyabolghasemi2022improving

Related papers

• Pre-training Tasks For Embedding-based Large-scale Retrieval (2020)0.00
• On The Interpolation Of Contextualized Term-based Ranking With BM25 For Query-by-example Retrieval (2022)7.50
• Document Optimization For Black-box Retrieval Via Reinforcement Learning (2026)0.00
• Rebol: Retrieval Via Bayesian Optimization With Batched LLM Relevance Observations And Query Reformulation (2026)0.00
• QDER: Query-specific Document And Entity Representations For Multi-vector Document Re-ranking (2025)0.00
• Multi-query Video Retrieval (2022)9.59
• Bixse: Improving Dense Retrieval Via Probabilistic Graded Relevance Distillation (2025)0.00
• Colbert: Efficient And Effective Passage Search Via Contextualized Late Interaction Over BERT (2020)0.00