Outfittransformer: Learning Outfit Representations For Fashion Recommendation

Abstract

Learning an effective outfit-level representation is critical for predicting the compatibility of items in an outfit, and retrieving complementary items for a partial outfit. We present a framework, OutfitTransformer, that uses the proposed task-specific tokens and leverages the self-attention mechanism to learn effective outfit-level representations encoding the compatibility relationships between all items in the entire outfit for addressing both compatibility prediction and complementary item retrieval tasks. For compatibility prediction, we design an outfit token to capture a global outfit representation and train the framework using a classification loss. For complementary item retrieval, we design a target item token that additionally takes the target item specification (in the form of a category or text description) into consideration. We train our framework using a proposed set-wise outfit ranking loss to generate a target item embedding given an outfit, and a target item speci

Stats

• citations25
• S2 citations—
• github stars0
• HF likes0
• heat score10.61
• arxiv keysarkar2022outfittransformer

Related papers

• Fashion Outfit Complementary Item Retrieval (2019)14.06
• A Hybrid Multimodal Deep Learning Framework For Intelligent Fashion Recommendation (2025)0.00
• Kisekloset For Fashion Retrieval And Recommendation (2025)0.00
• TATTOO: Training-free Aesthetic-aware Outfit Recommendation (2025)0.00
• Styling With Attention To Details (2018)0.00
• Looking At Outfit To Parse Clothing (2017)0.00
• Fad-vlp: Fashion Vision-and-language Pre-training Towards Unified Retrieval And Captioning (2022)7.81
• Masked Vision-language Transformer In Fashion (2022)12.41