Incremental Learning on Food Instance Segmentation
Food instance segmentation is essential to estimate the serving size of dishes in a food image. The recent cutting-edge techniques for instance segmentation are deep learning networks with impressive segmentation quality and fast computation. Nonetheless, they are hungry for data and expensive for annotation. This paper proposes an incremental learning framework to optimize the model performance given a limited data labelling budget. The power of the framework is a novel difficulty assessment model, which forecasts how challenging an unlabelled sample is to the latest trained instance segmentation model. The data collection procedure is divided into several stages, each in which a new sample package is collected. The framework allocates the labelling budget to the most difficult samples. The unlabelled samples that meet a certain qualification from the assessment model are used to generate pseudo-labels. Eventually, the manual labels and pseudo-labels are sent to the training data to improve the instance segmentation model. On four large-scale food datasets, our proposed framework outperforms current incremental learning benchmarks and achieves competitive performance with the model trained on fully annotated samples.
Code (0)
등록된 구현이 없습니다.
Tasks
Incremental LearningInstance SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
FoodSAM: Any Food Segmentation
In this paper, we explore the zero-shot capability of the Segment Anything Model (SAM) for food image segmentation. To address the lack of class-specific information in SAM-generated masks, we propose a novel framework, …
Image SegmentationInstance SegmentationPanoptic SegmentationSegmentation+1Deep Learning based Food Instance Segmentation using Synthetic Data
In the process of intelligently segmenting foods in images using deep neural networks for diet management, data collection and labeling for network training are very important but labor-intensive tasks. In order to solve…
Deep LearningInstance SegmentationManagementSegmentation+1Understanding Image2Video Domain Shift in Food Segmentation: An Instance-level Analysis on Apples
Food segmentation models trained on static images have achieved strong performance on benchmark datasets; however, their reliability in video settings remains poorly understood. In real-world applications such as food mo…
Instance SegmentationEfficient Microscopic Image Instance Segmentation for Food Crystal Quality Control
This paper is directed towards the food crystal quality control area for manufacturing, focusing on efficiently predicting food crystal counts and size distributions. Previously, manufacturers used the manual counting me…
Instance Segmentationobject-detectionObject DetectionSegmentation+1Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detection
The food packaging industry handles an immense variety of food products with wide-ranging shapes and sizes, even within one kind of food. Menus are also diverse and change frequently, making automation of pick-and-place …
Instance Segmentationobject-detectionObject DetectionSemantic Segmentation