paper-with-me

홈 › Papers

Ingredient-Level Food Image Segmentation for Nutrition Awareness

2026-06-23 · Jonesh Shrestha arxiv

Food images often contain several visible ingredients, so assigning one dish label to an entire image hides important visual structure. This work studies ingredient-level semantic segmentation on FoodSeg103, where the model predicts an ingredient class for each pixel. Two SegFormer variants were fine-tuned and evaluated under a controlled setup: SegFormer-B0 as the smaller baseline model and SegFormer-B1 as the larger final model. Both models use ImageNet-pretrained MiT backbones with newly initialized 104-class output layers. On the held-out FoodSeg103 test split of 2,135 images, B0 achieved 0.7709 pixel accuracy and 0.2521 mean IoU, while B1 achieved 0.7929 pixel accuracy and 0.3204 mean IoU. B1 improved every saved test metric, including a +0.0683 absolute gain in mean IoU. The system also converts predicted masks into visible ingredient-area percentages, giving a simple visual composition summary of the predicted meal. This summary can serve as a first-pass nutrition-awareness cue by providing a visual alternative to detailed food tracking similar to plate-based meal guidance, but it is not a direct estimate of calories, macronutrients, food mass, volume, density, or true portion size.

📄 PDF Abstract BibTeX arXiv:2606.24059

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic SegmentationImage Segmentation

Similar Papers 제목 키워드 기반

NutritionVerse-Real: An Open Access Manually Collected 2D Food Scene Dataset for Dietary Intake Estimation

2023-11-20 · Chi-en Amy Tai, Saeejith Nair, Olivia Markham, Matthew Keller 외

Dietary intake estimation plays a crucial role in understanding the nutritional habits of individuals and populations, aiding in the prevention and management of diet-related health issues. Accurate estimation requires c…

DiversityManagement

Advancing Food Nutrition Estimation via Visual-Ingredient Feature Fusion

2025-05-13 · Huiyan Qi, Bin Zhu, Chong-Wah Ngo, Jingjing Chen 외

Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingredient recognition, progress in nutrition…

Data AugmentationNutrition

FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoning

2026-05-29 · Mingyang Mao, Bhargav Rishi Medisetti, Utkarsh Grover, Tanvir Ibrahim 외 arxiv

Food-as-Medicine requires models to reason beyond what a dish is or what nutrition it contains: they must decide whether a concrete food choice is appropriate for a specific health condition. Existing food AI benchmarks …

Question Answering

RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Models

2024-07-17 · Pengkun Jiao, Xinlan Wu, Bin Zhu, Jingjing Chen 외

Large Multi-modal Models (LMMs) have significantly advanced a variety of vision-language tasks. The scalability and availability of high-quality training data play a pivotal role in the success of LMMs. In the realm of f…

GPUNutrition

UMDFood: Vision-language models boost food composition compilation

2023-05-18 · Peihua Ma, Yixin Wu, Ning Yu, Yang Zhang 외

Nutrition information is crucial in precision nutrition and the food industry. The current food composition compilation paradigm relies on laborious and experience-dependent methods. However, these methods struggle to ke…

Language ModellingNutrition