What Looks Good With My Sofa: Multimodal Search Engine For Interior Design
2017 · Ivona Tautkute, Aleksandra Możejko, Wojciech Stokowiec, et al.
Abstract
In this paper, we propose a multi-modal search engine for interior design that combines visual and textual queries. The goal of our engine is to retrieve interior objects, e.g. furniture or wall clocks, that share visual and aesthetic similarities with the query. Our search engine allows the user to take a photo of a room and retrieve with a high recall a list of items identical or visually similar to those present in the photo. Additionally, it allows to return other items that aesthetically and stylistically fit well together. To achieve this goal, our system blends the results obtained using textual and visual modalities. Thanks to this blending strategy, we increase the average style similarity score of the retrieved items by 11%. Our work is implemented as a Web-based application and it is planned to be opened to the public.
Authors
(none)
Tags
Stats
Related papers
- Deepstyle: Multimodal Search Engine For Fashion And Interior Design (2018)13.17
- From Pixels To Purchase: Building And Evaluating A Taxonomy-decoupled Visual Search Engine For Home Goods E-commerce (2026)0.00
- Semantic-enhanced Modality-asymmetric Retrieval For Online E-commerce Search (2025)0.00
- WISE: A Multimodal Search Engine For Visual Scenes, Audio, Objects, Faces, Speech, And Metadata (2026)0.00
- Image Retrieval With Mixed Initiative And Multimodal Feedback (2018)8.09
- MUST: An Effective And Scalable Framework For Multimodal Search Of Target Modality (2023)7.81
- Multimodal Semantic Retrieval For Product Search (2025)3.58
- MRSE: An Efficient Multi-modality Retrieval System For Large Scale E-commerce (2024)0.00