An Analysis Of A BERT Deep Learning Strategy On A Technology Assisted Review Task
2021 · Alexandros Ioannidis
Abstract
Document screening is a central task within Evidenced Based Medicine, which is a clinical discipline that supplements scientific proof to back medical decisions. Given the recent advances in DL (Deep Learning) methods applied to Information Retrieval tasks, I propose a DL document classification approach with BERT or PubMedBERT embeddings and a DL similarity search path using SBERT embeddings to reduce physicians' tasks of screening and classifying immense amounts of documents to answer clinical queries. I test and evaluate the retrieval effectiveness of my DL strategy on the 2017 and 2018 CLEF eHealth collections. I find that the proposed DL strategy works, I compare it to the recently successful BM25 plus RM3 model, and conclude that the suggested method accomplishes advanced retrieval performance in the initial ranking of the articles with the aforementioned datasets, for the CLEF eHealth Technologically Assisted Reviews in Empirical Medicine Task.
Authors
(none)
Tags
Stats
Related papers
- Deep Retrieval At Checkthat! 2025: Identifying Scientific Papers From Implicit Social Media Mentions Via Hybrid Retrieval And Re-ranking (2025)0.00
- Improving Bert-based Query-by-document Retrieval With Multi-task Optimization (2022)9.92
- Beyond Retrieval: Ensembling Cross-encoders And GPT Rerankers With Llms For Biomedical QA (2025)0.00
- Mirror Matching: Document Matching Approach In Seed-driven Document Ranking For Medical Systematic Reviews (2021)0.00
- Diagnosable Colbert: Debugging Late-interaction Retrieval Models Using A Learned Latent Space As Reference (2026)0.00
- Diagnosing BERT With Retrieval Heuristics (2022)10.21
- Airwaves At Checkthat! 2025: Retrieving Scientific Sources For Implicit Claims On Social Media With Dual Encoders And Neural Re-ranking (2025)0.00
- Pre-training Tasks For Embedding-based Large-scale Retrieval (2020)0.00