Cross-media Scientific Research Achievements Retrieval Based On Deep Language Model

Abstract

Science and technology big data contain a lot of cross-media information.There are images and texts in the scientific paper.The s ingle modal search method cannot well meet the needs of scientific researchers.This paper proposes a cross-media scientific research achievements retrieval method based on deep language model (CARDL).It achieves a unified cross-media semantic representation by learning the semantic association between different modal data, and is applied to the generation of text semantic vector of scientific research achievements, and then cross-media retrieval is realized through semantic similarity matching between different modal data.Experimental results show that the proposed CARDL method achieves better cross-modal retrieval performance than existing methods. Key words science and technology big data ; cross-media retrieval; cross-media semantic association learning; deep language model; semantic similarity

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2022cross

Related papers

• Deep Learning Techniques For Future Intelligent Cross-media Retrieval (2020)0.00
• Scientific And Technological Information Oriented Semantics-adversarial And Media-adversarial Cross-media Retrieval (2022)0.00
• Cross-modal Retrieval: A Systematic Review Of Methods And Future Directions (2023)12.81
• Cross-modal Deep Metric Learning With Multi-task Regularization (2017)9.03
• Do Cross Modal Systems Leverage Semantic Relationships? (2019)7.16
• Towards Cross-modal Text-molecule Retrieval With Better Modality Alignment (2024)4.52
• CART: A Generative Cross-modal Retrieval Framework With Coarse-to-fine Semantic Modeling (2024)3.58
• CMIR-NET : A Deep Learning Based Model For Cross-modal Retrieval In Remote Sensing (2019)13.34