A Compact Embedding For Facial Expression Similarity

Abstract

Most of the existing work on automatic facial expression analysis focuses on discrete emotion recognition, or facial action unit detection. However, facial expressions do not always fall neatly into pre-defined semantic categories. Also, the similarity between expressions measured in the action unit space need not correspond to how humans perceive expression similarity. Different from previous work, our goal is to describe facial expressions in a continuous fashion using a compact embedding space that mimics human visual preferences. To achieve this goal, we collect a large-scale faces-in-the-wild dataset with human annotations in the form: Expressions A and B are visually more similar when compared to expression C, and use this dataset to train a neural network that produces a compact (16-dimensional) expression embedding. We experimentally demonstrate that the learned embedding can be successfully used for various applications such as expression retrieval, photo album summarization,

Stats

• citations82
• S2 citations—
• github stars0
• HF likes0
• heat score14.39
• arxiv keyvemulapalli2018a

Related papers

• Deep Metric Structured Learning For Facial Expression Recognition (2020)0.00
• Triplet Similarity Embedding For Face Verification (2016)0.00
• From A Glance To "gotcha": Interactive Facial Image Retrieval With Progressive Relevance Feedback (2020)0.00
• Bundle Optimization For Multi-aspect Embedding (2017)0.00
• Accurate And Efficient Similarity Search For Large Scale Face Recognition (2018)0.00
• Spatially Optimized Compact Deep Metric Learning Model For Similarity Search (2024)0.00
• A Survey On Efficient Processing Of Similarity Queries Over Neural Embeddings (2022)0.00
• Learnt Quasi-transitive Similarity For Retrieval From Large Collections Of Faces (2016)5.24