Team IELAB At TREC Clinical Trial Track 2023: Enhancing Clinical Trial Retrieval With Neural Rankers And Large Language Models

Abstract

We describe team ielab from CSIRO and The University of Queensland's approach to the 2023 TREC Clinical Trials Track. Our approach was to use neural rankers but to utilise Large Language Models to overcome the issue of lack of training data for such rankers. Specifically, we employ ChatGPT to generate relevant patient descriptions for randomly selected clinical trials from the corpus. This synthetic dataset, combined with human-annotated training data from previous years, is used to train both dense and sparse retrievers based on PubmedBERT. Additionally, a cross-encoder re-ranker is integrated into the system. To further enhance the effectiveness of our approach, we prompting GPT-4 as a TREC annotator to provide judgments on our run files. These judgments are subsequently employed to re-rank the results. This architecture tightly integrates strong PubmedBERT-based rankers with the aid of SOTA Large Language Models, demonstrating a new approach to clinical trial retrieval.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhuang2024team

Related papers

• Beyond Retrieval: Ensembling Cross-encoders And GPT Rerankers With Llms For Biomedical QA (2025)0.00
• Overview Of The TREC 2021 Deep Learning Track (2025)10.85
• Generative Relevance Feedback And Convergence Of Adaptive Re-ranking: University Of Glasgow Terrier Team At TREC DL 2023 (2024)0.00
• Naver Labs Europe (SPLADE) @ TREC Deep Learning 2022 (2023)0.00
• DS@GT At TREC TOT 2025: Bridging Vague Recollection With Fusion Retrieval And Learned Reranking (2026)0.00
• Graph-based Retriever Captures The Long Tail Of Biomedical Knowledge (2024)0.00
• Deep Retrieval At Checkthat! 2025: Identifying Scientific Papers From Implicit Social Media Mentions Via Hybrid Retrieval And Re-ranking (2025)0.00
• Airwaves At Checkthat! 2025: Retrieving Scientific Sources For Implicit Claims On Social Media With Dual Encoders And Neural Re-ranking (2025)0.00