Attention Guided Cosine Margin For Overcoming Class-Imbalance in Few-Shot Road Object Detection
Few-shot object detection (FSOD) localizes and classifies objects in an image given only a few data samples. Recent trends in FSOD research show the adoption of metric and meta-learning techniques, which are prone to catastrophic forgetting and class confusion. To overcome these pitfalls in metric learning based FSOD techniques, we introduce Attention Guided Cosine Margin (AGCM) that facilitates the creation of tighter and well separated class-specific feature clusters in the classification head of the object detector. Our novel Attentive Proposal Fusion (APF) module minimizes catastrophic forgetting by reducing the intra-class variance among co-occurring classes. At the same time, the proposed Cosine Margin Cross-Entropy loss increases the angular margin between confusing classes to overcome the challenge of class confusion between already learned (base) and newly added (novel) classes. We conduct our experiments on the challenging India Driving Dataset (IDD), which presents a real-world class-imbalanced setting alongside popular FSOD benchmark PASCAL-VOC. Our method outperforms State-of-the-Art (SoTA) approaches by up to 6.4 mAP points on the IDD-OS and up to 2.0 mAP points on the IDD-10 splits for the 10-shot setting. On the PASCAL-VOC dataset, we outperform existing SoTA approaches by up to 4.9 mAP points.
Code (1)
Tasks
Few-Shot Object DetectionMeta-LearningMetric Learningobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Loss
A number of studies point out that current Visual Question Answering (VQA) models are severely affected by the language prior problem, which refers to blindly making predictions based on the language shortcut. Some effor…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Conditionally Site-Independent Neural Evolution of Antibody Sequences
Common deep learning approaches for antibody engineering focus on modeling the marginal distribution of sequences. By treating sequences as independent samples, however, these methods overlook affinity maturation as a ri…
CosFace: Large Margin Cosine Loss for Deep Face Recognition
Face recognition has made extraordinary progress owing to the advancement of deep convolutional neural networks (CNNs). The central task of face recognition, including face verification and identification, involves face …
Face IdentificationFace RecognitionFace VerificationScalable Angular Discriminative Deep Metric Learning for Face Recognition
With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class vari…
Face RecognitionMetric LearningDeep Angular Embedding and Feature Correlation Attention for Breast MRI Cancer Analysis
Accurate and automatic analysis of breast MRI plays an important role in early diagnosis and successful treatment planning for breast cancer. Due to the heterogeneity nature, accurate diagnosis of tumors remains a challe…
Feature CorrelationSpecificity