Single-Stage Heavy-Tailed Food Classification

2023-07-01 · Jiangpeng He, Fengqing Zhu

Deep learning based food image classification has enabled more accurate nutrition content analysis for image-based dietary assessment by predicting the types of food in eating occasion images. However, there are two major obstacles to apply food classification in real life applications. First, real life food images are usually heavy-tailed distributed, resulting in severe class-imbalance issue. Second, it is challenging to train a single-stage (i.e. end-to-end) framework under heavy-tailed data distribution, which cause the over-predictions towards head classes with rich instances and under-predictions towards tail classes with rare instance. In this work, we address both issues by introducing a novel single-stage heavy-tailed food classification framework. Our method is evaluated on two heavy-tailed food benchmark datasets, Food101-LT and VFN-LT, and achieves the best performance compared to existing work with over 5% improvements for top-1 accuracy.

📄 PDF Abstract BibTeX arXiv:2307.00182

Code (0)

등록된 구현이 없습니다.

Tasks

Classification image-classification Image Classification Nutrition

Long-tailed Food Classification

2022-10-26 · Jiangpeng He, Luotao Lin, Heather Eicher-Miller, Fengqing Zhu

Food classification serves as the basic step of image-based dietary assessment to predict the types of foods in each input image. However, food image predictions in a real world scenario are usually long-tail distributed…

Classification Data Augmentation Knowledge Distillation

LLMs-based Augmentation for Domain Adaptation in Long-tailed Food Datasets

2025-11-20 · Qing Wang, Chong-Wah Ngo, Ee-Peng Lim, Qianru Sun arxiv

Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured by users in the free-living environment.…

Domain Adaptation

FMiFood: Multi-modal Contrastive Learning for Food Image Classification

2024-08-07 · Xinyue Pan, Jiangpeng He, Fengqing Zhu

Food image classification is the fundamental step in image-based dietary assessment, which aims to estimate participants' nutrient intake from eating occasion images. A common challenge of food images is the intra-class …

Classification Contrastive Learning Diversity image-classification+1

Heavy-Tailed Process Priors for Selective Shrinkage

2010-12-01 · NeurIPS 2010 12 · Fabian L. Wauthier, Michael. I. Jordan

Heavy-tailed distributions are often used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with ``outliers'' in input space, which are iso…

Gaussian Processes General Classification regression

Asymptotic Classification Error for Heavy-Tailed Renewal Processes

2024-08-20 · Xinhui Rong, Victor Solo

Despite the widespread occurrence of classification problems and the increasing collection of point process data across many disciplines, study of error probability for point process classification only emerged very rece…

Classification