paper-with-me

홈 › Papers

Rethinking Intersection Over Union for Small Object Detection in Few-Shot Regime

2023-07-17 · Pierre Le Jeune, Anissa Mokraoui

In Few-Shot Object Detection (FSOD), detecting small objects is extremely difficult. The limited supervision cripples the localization capabilities of the models and a few pixels shift can dramatically reduce the Intersection over Union (IoU) between the ground truth and predicted boxes for small objects. To this end, we propose Scale-adaptive Intersection over Union (SIoU), a novel box similarity measure. SIoU changes with the objects' size, it is more lenient with small object shifts. We conducted a user study and SIoU better aligns than IoU with human judgment. Employing SIoU as an evaluation criterion helps to build more user-oriented models. SIoU can also be used as a loss function to prioritize small objects during training, outperforming existing loss functions. SIoU improves small object detection in the non-few-shot regime, but this setting is unrealistic in the industry as annotated detection datasets are often too expensive to acquire. Hence, our experiments mainly focus on the few-shot regime to demonstrate the superiority and versatility of SIoU loss. SIoU improves significantly FSOD performance on small objects in both natural (Pascal VOC and COCO datasets) and aerial images (DOTA and DIOR). In aerial imagery, small objects are critical and SIoU loss achieves new state-of-the-art FSOD on DOTA and DIOR.

📄 PDF Abstract BibTeX arXiv:2307.09562

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Object DetectionObjectobject-detectionObject DetectionSmall Object Detection

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Rethinking Vision Transformer for Object Centric Foundation Models

2025-02-04 · Manuel Traub, Martin V. Butz

Recent state-of-the-art object segmentation mechanisms, such as the Segment Anything Model (SAM) and FastSAM, first encode the full image over several layers and then focus on generating the mask for one particular objec…

ObjectObject TrackingSegmentationSemantic Segmentation

The Lovász-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks

2017-05-24 · CVPR 2018 6 · Maxim Berman, Amal Rannen Triki, Matthew B. Blaschko

The Jaccard index, also referred to as the intersection-over-union score, is commonly employed in the evaluation of image segmentation results given its perceptual qualities, scale invariance - which lends appropriate re…

Image SegmentationSegmentationSemantic Segmentation

The Lovász-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks

2018-06-01 · CVPR 2018 6 · Maxim Berman, Amal Rannen Triki, Matthew B. Blaschko

The Jaccard index, also referred to as the intersection-over-union score, is commonly employed in the evaluation of image segmentation results given its perceptual qualities, scale invariance - which lends appropriate re…

Image SegmentationSegmentationSemantic Segmentation

Fast Hand Detection in Collaborative Learning Environments

2021-10-13 · Sravani Teeparthi, Venkatesh Jatla, Marios S. Pattichis, Sylvia Celedon Pattichis 외

Long-term object detection requires the integration of frame-based results over several seconds. For non-deformable objects, long-term detection is often addressed using object detection followed by video tracking. Unfor…

Data AugmentationHand DetectionObjectobject-detection+1

Optimizing Expected Intersection-Over-Union With Candidate-Constrained CRFs

2015-12-01 · ICCV 2015 12 · Faruk Ahmed, Dany Tarlow, Dhruv Batra

We study the question of how to make loss-aware predictions in image segmentation settings where the evaluation function is the Intersection-over-Union (IoU) measure that is used widely in evaluating image segmentation s…

Image SegmentationSegmentationSemantic Segmentation