paper-with-me

홈 › Papers

Exploring Classification Equilibrium in Long-Tailed Object Detection

2021-08-17 · ICCV 2021 10 · Chengjian Feng, Yujie Zhong, Weilin Huang

The conventional detectors tend to make imbalanced classification and suffer performance drop, when the distribution of the training data is severely skewed. In this paper, we propose to use the mean classification score to indicate the classification accuracy for each category during training. Based on this indicator, we balance the classification via an Equilibrium Loss (EBL) and a Memory-augmented Feature Sampling (MFS) method. Specifically, EBL increases the intensity of the adjustment of the decision boundary for the weak classes by a designed score-guided loss margin between any two classes. On the other hand, MFS improves the frequency and accuracy of the adjustment of the decision boundary for the weak classes through over-sampling the instance features of those classes. Therefore, EBL and MFS work collaboratively for finding the classification equilibrium in long-tailed detection, and dramatically improve the performance of tail classes while maintaining or even improving the performance of head classes. We conduct experiments on LVIS using Mask R-CNN with various backbones including ResNet-50-FPN and ResNet-101-FPN to show the superiority of the proposed method. It improves the detection performance of tail classes by 15.6 AP, and outperforms the most recent long-tailed object detectors by more than 1 AP. Code is available at https://github.com/fcjian/LOCE.

📄 PDF Abstract BibTeX arXiv:2108.07507

Code (1)

fcjian/loce 공식 구현 pytorch

Tasks

Classificationimbalanced classificationInstance SegmentationLong-tailed Object DetectionObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Brain functions emerge as thermal equilibrium states of the connectome

2024-08-26 · Elkaïoum M. Moutuou, Habib Benali

A fundamental paradigm in neuroscience is that cognitive functions -- such as perception, learning, memory, and locomotion -- are shaped by the brain's structural organization. However, the theoretical principles explain…

Image-Level or Object-Level? A Tale of Two Resampling Strategies for Long-Tailed Detection

2021-04-12 · Nadine Chang, Zhiding Yu, Yu-Xiong Wang, Anima Anandkumar 외

Training on datasets with long-tailed distributions has been challenging for major recognition tasks such as classification and detection. To deal with this challenge, image resampling is typically introduced as a simple…

Object

Exploring Contrastive Learning for Long-Tailed Multi-Label Text Classification

2024-04-12 · Alexandre Audibert, Aurélien Gauffre, Massih-Reza Amini

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the in…

Contrastive LearningMulti-class ClassificationMulti Label Text ClassificationMulti-Label Text Classification+2

Equilibrium contrastive learning for imbalanced image classification

2026-02-10 · Sumin Roh, Harim Kim, Ho Yun Lee, Il Yong Chun arxiv

Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset. Recently, several supervised CL methods have been proposed to promote an ideal…

Contrastive LearningImage Classification

Making Reliable and Flexible Decisions in Long-tailed Classification

2025-01-23 · Bolian Li, Ruqi Zhang

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain t…

Decision Makingimage-classificationImage ClassificationUncertainty Quantification