paper-with-me

홈 › Papers

FoodFusion: A Latent Diffusion Model for Realistic Food Image Generation

2023-12-06 · Olivia Markham, Yuhao Chen, Chi-en Amy Tai, Alexander Wong

Current state-of-the-art image generation models such as Latent Diffusion Models (LDMs) have demonstrated the capacity to produce visually striking food-related images. However, these generated images often exhibit an artistic or surreal quality that diverges from the authenticity of real-world food representations. This inadequacy renders them impractical for applications requiring realistic food imagery, such as training models for image-based dietary assessment. To address these limitations, we introduce FoodFusion, a Latent Diffusion model engineered specifically for the faithful synthesis of realistic food images from textual descriptions. The development of the FoodFusion model involves harnessing an extensive array of open-source food datasets, resulting in over 300,000 curated image-caption pairs. Additionally, we propose and employ two distinct data cleaning methodologies to ensure that the resulting image-text pairs maintain both realism and accuracy. The FoodFusion model, thus trained, demonstrates a remarkable ability to generate food images that exhibit a significant improvement in terms of both realism and diversity over the publicly available image generation models. We openly share the dataset and fine-tuned models to support advancements in this critical field of food image synthesis at https://bit.ly/genai4good.

📄 PDF Abstract BibTeX arXiv:2312.03540

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.

Similar Papers 제목 키워드 기반

Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models

2024-08-26 · Chaohua Shi, Xuan Wang, Si Shi, Xule Wang 외

Food image composition requires the use of existing dish images and background images to synthesize a natural new image, while diffusion models have made significant advancements in image generation, enabling the constru…

DenoisingImage Generation

Understanding the Limitations of Diffusion Concept Algebra Through Food

2024-06-05 · E. Zhixuan Zeng, Yuhao Chen, Alexander Wong

Image generation techniques, particularly latent diffusion models, have exploded in popularity in recent years. Many techniques have been developed to manipulate and clarify the semantic concepts these large-scale models…

DiversityImage Generation

Diffusion Model with Clustering-based Conditioning for Food Image Generation

2023-09-01 · Yue Han, Jiangpeng He, Mridul Gupta, Edward J. Delp 외

Image-based dietary assessment serves as an efficient and accurate solution for recording and analyzing nutrition intake using eating occasion images as input. Deep learning-based techniques are commonly used to perform …

ClusteringData AugmentationImage GenerationNutrition

Real-Time Cooked Food Image Synthesis and Visual Cooking Progress Monitoring on Edge Devices

2025-11-21 · Jigyasa Gupta, Soumya Goyal, Anil Kumar, Ishan Jindal arxiv

Synthesizing realistic cooked food images from raw inputs on edge devices is a challenging generative task, requiring models to capture complex changes in texture, color and structure during cooking. Existing image-to-im…

Image Generation

Improving text-conditioned latent diffusion for cancer pathology

2024-12-09 · Aakash Madhav Rao, Debayan Gupta

The development of generative models in the past decade has allowed for hyperrealistic data synthesis. While potentially beneficial, this synthetic data generation process has been relatively underexplored in cancer hist…

GPUSynthetic Data Generation