Evit: Privacy-preserving Image Retrieval Via Encrypted Vision Transformer In Cloud Computing

Abstract

Image retrieval systems help users to browse and search among extensive images in real-time. With the rise of cloud computing, retrieval tasks are usually outsourced to cloud servers. However, the cloud scenario brings a daunting challenge of privacy protection as cloud servers cannot be fully trusted. To this end, image-encryption-based privacy-preserving image retrieval schemes have been developed, which first extract features from cipher-images, and then build retrieval models based on these features. Yet, most existing approaches extract shallow features and design trivial retrieval models, resulting in insufficient expressiveness for the cipher-images. In this paper, we propose a novel paradigm named Encrypted Vision Transformer (EViT), which advances the discriminative representations capability of cipher-images. First, in order to capture comprehensive ruled information, we extract multi-level local length sequence and global Huffman-code frequency features from the cipher-image

Stats

• citations33
• S2 citations—
• github stars12
• HF likes0
• heat score13.71
• arxiv keyfeng2022evit

Related papers

• Evidential Transformers For Improved Image Retrieval (2024)0.00
• A Privacy-preserving Content-based Image Retrieval Scheme Allowing Mixed Use Of Encrypted And Plain Images (2020)0.00
• Training Vision Transformers For Image Retrieval (2021)0.00
• Boosting Vision Transformers For Image Retrieval (2022)15.28
• Vision Transformer Hashing For Image Retrieval (2021)17.01
• A Privacy-preserving Image Retrieval Scheme Using A Codebook Generated From Independent Plain-image Dataset (2021)0.00
• Transhash: Transformer-based Hamming Hashing For Efficient Image Retrieval (2021)13.44
• Investigating The Vision Transformer Model For Image Retrieval Tasks (2021)10.74