Recipe1m+: A Dataset For Learning Cross-modal Embeddings For Cooking Recipes And Food Images

Abstract

In this paper, we introduce Recipe1M+, a new large-scale, structured corpus of over one million cooking recipes and 13 million food images. As the largest publicly available collection of recipe data, Recipe1M+ affords the ability to train high-capacity modelson aligned, multimodal data. Using these data, we train a neural network to learn a joint embedding of recipes and images that yields impressive results on an image-recipe retrieval task. Moreover, we demonstrate that regularization via the addition of a high-level classification objective both improves retrieval performance to rival that of humans and enables semantic vector arithmetic. We postulate that these embeddings will provide a basis for further exploration of the Recipe1M+ dataset and food and cooking in general. Code, data and models are publicly available.

Stats

• citations198
• S2 citations—
• github stars0
• HF likes0
• heat score17.24
• arxiv keymarin2018recipe1m

Related papers

• Cross-modal Retrieval In The Cooking Context: Learning Semantic Text-image Embeddings (2018)0.00
• SIMMER: Cross-modal Food Image--recipe Retrieval Via Mllm-based Embedding (2026)0.00
• Images & Recipes: Retrieval In The Cooking Context (2018)3.58
• Cross-modal Food Retrieval: Learning A Joint Embedding Of Food Images And Recipes With Semantic Consistency And Attention Mechanism (2020)12.10
• CHEF: Cross-modal Hierarchical Embeddings For Food Domain Retrieval (2021)8.35
• MCEN: Bridging Cross-modal Gap Between Cooking Recipes And Dish Images With Latent Variable Model (2020)13.39
• Transformer-based Cross-modal Recipe Embeddings With Large Batch Training (2022)5.84
• Dividing And Conquering Cross-modal Recipe Retrieval: From Nearest Neighbours Baselines To Sota (2019)0.00