paper-with-me

홈 › Papers

The Art of Food: Meal Image Synthesis from Ingredients

2019-05-09 · Fangda Han, Ricardo Guerrero, Vladimir Pavlovic

In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual descriptions of its ingredients. Previous works on synthesis of images from text typically rely on pre-trained text models to extract text features, followed by a generative neural networks (GANs) aimed to generate realistic images conditioned on the text features. These works mainly focus on generating spatially compact and well-defined categories of objects, such as birds or flowers. In contrast, meal images are significantly more complex, consisting of multiple ingredients whose appearance and spatial qualities are further modified by cooking methods. We propose a method that first builds an attention-based ingredients-image association model, which is then used to condition a generative neural network tasked with synthesizing meal images. Furthermore, a cycle-consistent constraint is added to further improve image quality and control appearance. Extensive experiments show our model is able to generate meal image corresponding to the ingredients, which could be used to augment existing dataset for solving other computational food analysis problems.

📄 PDF Abstract BibTeX arXiv:1905.13149

Code (1)

CorneliusHsiao/FoodMethodGAN pytorch

Tasks

Image Generation

Similar Papers 제목 키워드 기반

CookGAN: Meal Image Synthesis from Ingredients

2020-02-25 · Fangda Han, Ricardo Guerrero, Vladimir Pavlovic

In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual list of its ingredients. Previous works on synthesis of images from t…

Image Generation

Inverse Cooking: Recipe Generation from Food Images

2018-12-14 · CVPR 2019 6 · Amaia Salvador, Michal Drozdzal, Xavier Giro-i-Nieto, Adriana Romero

People enjoy food photography because they appreciate food. Behind each meal there is a story described in a complex recipe and, unfortunately, by simply looking at a food image we do not have access to its preparation p…

Recipe GenerationRetrieval

Ingredient-Level Food Image Segmentation for Nutrition Awareness

2026-06-23 · Jonesh Shrestha arxiv

Food images often contain several visible ingredients, so assigning one dish label to an entire image hides important visual structure. This work studies ingredient-level semantic segmentation on FoodSeg103, where the mo…

Semantic SegmentationImage Segmentation

How Much You Ate? Food Portion Estimation on Spoons

2024-05-12 · Aaryam Sharma, Chris Czarnecki, Yuhao Chen, Pengcheng Xi 외

Monitoring dietary intake is a crucial aspect of promoting healthy living. In recent years, advances in computer vision technology have facilitated dietary intake monitoring through the use of images and depth cameras. H…

ARChef: An iOS-Based Augmented Reality Cooking Assistant Powered by Multimodal Gemini LLM

2024-12-01 · Rithik Vir, Parsa Madinei

Cooking meals can be difficult, causing many to resort to cookbooks and online recipes. However, relying on these traditional methods of cooking often results in missing ingredients, nutritional hazards, and unsatisfacto…

Language ModelingLanguage ModellingLarge Language Model