Benchmarking Post-Hoc Unknown-Category Detection in Food Recognition
Food recognition models often struggle to distinguish between seen and unseen samples, frequently misclassifying samples from unseen categories by assigning them an in-distribution (ID) label. This misclassification presents significant challenges when deploying these models in real-world applications, particularly within automatic dietary assessment systems, where incorrect labels can lead to cascading errors throughout the system. Ideally, such models should prompt the user when an unknown sample is encountered, allowing for corrective action. Given no prior research exploring food recognition in real-world settings, in this work we conduct an empirical analysis of various post-hoc out-of-distribution (OOD) detection methods for fine-grained food recognition. Our findings indicate that virtual logit matching (ViM) performed the best overall, likely due to its combination of logits and feature-space representations. Additionally, our work reinforces prior notions in the OOD domain, noting that models with higher ID accuracy performed better across the evaluated OOD detection methods. Furthermore, transformer-based architectures consistently outperformed convolution-based models in detecting OOD samples across various methods.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingFood RecognitionOut of Distribution (OOD) DetectionSimilar Papers 제목 키워드 기반
On the Complementarity of Images and Text for the Expression of Emotions in Social Media
Authors of posts in social media communicate their emotions and what causes them with text and images. While there is work on emotion and stimulus detection for each modality separately, it is yet unknown if the modaliti…
Towards Generalized Few-Shot Open-Set Object Detection
Open-set object detection (OSOD) aims to detect the known categories and reject unknown objects in a dynamic world, which has achieved significant attention. However, previous approaches only consider this problem in dat…
Few Shot Open Set Object DetectionObjectobject-detectionObject DetectionFDDet: Achieving Data-Efficient Food Defect Detection Under Real-World Scenarios
Food defect detection is critical for automated quality control, yet existing studies lack unified benchmarks and suffer from data scarcity. We introduce FDD-48, a comprehensive dataset with fine-grained annotations acro…
Data AugmentationBoosting Few-Shot Open-Set Object Detection via Prompt Learning and Robust Decision Boundary
Few-shot Open-set Object Detection (FOOD) poses a challenge in many open-world scenarios. It aims to train an open-set detector to detect known objects while rejecting unknowns with scarce training samples. Existing FOOD…
Few Shot Open Set Object Detectionobject-detectionObject DetectionPrompt LearningAn Algorithm for Recommending Groceries Based on an Item Ranking Method
This research proposes a new recommender system algorithm for online grocery shopping. The algorithm is based on the perspective that, since the grocery items are usually bought in bulk, a grocery recommender system shou…
Recommendation Systems