Learning To Authenticate With Deep Multibiometric Hashing And Neural Network Decoding

Abstract

In this paper, we propose a novel multimodal deep hashing neural decoder (MDHND) architecture, which integrates a deep hashing framework with a neural network decoder (NND) to create an effective multibiometric authentication system. The MDHND consists of two separate modules: a multimodal deep hashing (MDH) module, which is used for feature-level fusion and binarization of multiple biometrics, and a neural network decoder (NND) module, which is used to refine the intermediate binary codes generated by the MDH and compensate for the difference between enrollment and probe biometrics (variations in pose, illumination, etc.). Use of NND helps to improve the performance of the overall multimodal authentication system. The MDHND framework is trained in 3 steps using joint optimization of the two modules. In Step 1, the MDH parameters are trained and learned to generate a shared multimodal latent code; in Step 2, the latent codes from Step 1 are passed through a conventional error-correctin

Stats

• citations15
• S2 citations—
• github stars0
• HF likes0
• heat score9.03
• arxiv keytalreja2019learning

Related papers

• Deep Hashing For Secure Multimodal Biometrics (2020)14.27
• Error-corrected Margin-based Deep Cross-modal Hashing For Facial Image Retrieval (2020)8.09
• Learning To Hash With Binary Deep Neural Network (2016)14.93
• HHF: Hashing-guided Hinge Function For Deep Hashing Retrieval (2021)14.24
• Deep Semantic Multimodal Hashing Network For Scalable Image-text And Video-text Retrievals (2019)14.43
• Dual Asymmetric Deep Hashing Learning (2018)9.03
• Deep Hashing: A Joint Approach For Image Signature Learning (2016)5.24
• Fusion-supervised Deep Cross-modal Hashing (2019)8.60