FoodFusion: A Latent Diffusion Model for Realistic Food Image Generation
Current state-of-the-art image generation models such as Latent Diffusion Models (LDMs) have demonstrated the capacity to produce visually striking food-related images. However, these generated images often exhibit an artistic or surreal quality that diverges from the authenticity of real-world food representations. This inadequacy renders them impractical for applications requiring realistic food imagery, such as training models for image-based dietary assessment. To address these limitations, we introduce FoodFusion, a Latent Diffusion model engineered specifically for the faithful synthesis of realistic food images from textual descriptions. The development of the FoodFusion model involves harnessing an extensive array of open-source food datasets, resulting in over 300,000 curated image-caption pairs. Additionally, we propose and employ two distinct data cleaning methodologies to ensure that the resulting image-text pairs maintain both realism and accuracy. The FoodFusion model, thus trained, demonstrates a remarkable ability to generate food images that exhibit a significant improvement in terms of both realism and diversity over the publicly available image generation models. We openly share the dataset and fine-tuned models to support advancements in this critical field of food image synthesis at https://bit.ly/genai4good.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityImage GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models
Food image composition requires the use of existing dish images and background images to synthesize a natural new image, while diffusion models have made significant advancements in image generation, enabling the constru…
DenoisingImage GenerationUnderstanding the Limitations of Diffusion Concept Algebra Through Food
Image generation techniques, particularly latent diffusion models, have exploded in popularity in recent years. Many techniques have been developed to manipulate and clarify the semantic concepts these large-scale models…
DiversityImage GenerationDiffusion Model with Clustering-based Conditioning for Food Image Generation
Image-based dietary assessment serves as an efficient and accurate solution for recording and analyzing nutrition intake using eating occasion images as input. Deep learning-based techniques are commonly used to perform …
ClusteringData AugmentationImage GenerationNutritionReal-Time Cooked Food Image Synthesis and Visual Cooking Progress Monitoring on Edge Devices
Synthesizing realistic cooked food images from raw inputs on edge devices is a challenging generative task, requiring models to capture complex changes in texture, color and structure during cooking. Existing image-to-im…
Image GenerationImproving text-conditioned latent diffusion for cancer pathology
The development of generative models in the past decade has allowed for hyperrealistic data synthesis. While potentially beneficial, this synthetic data generation process has been relatively underexplored in cancer hist…
GPUSynthetic Data Generation