paper-with-me

홈 › Papers

Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regression

2026-09-04 · Juncheng Zhou, Jiaxi Lu, Weijing Zeng, Zhong Li, Hao Qi, Jingsong Cui arxiv

Deep Imbalanced Regression (DIR) is pervasive in continuous prediction tasks across diverse modalities, such as age estimation, depth prediction, and protein mutation activity prediction, where label-scarce tail samples often carry higher practical value. However, most existing methods still learn deterministic point mappings under mean squared error or its simple variants, implicitly assuming a uniform uncertainty level across all samples and thereby overlooking the instance-wise heteroscedasticity that is widespread in long-tailed data. We further point out that even heteroscedastic negative log-likelihood suffers from a gradient coupling issue, which, under DIR scenarios, weakens the learning signal of hard tail samples and leads to optimization inertia as well as tail underfitting. To address this, we propose DUO, an uncertainty-aware long-tailed regression framework. Specifically, the proposed method models the regression target as a conditional Gaussian distribution to explicitly characterize instance-level predictive uncertainty, and transforms uncertainty into a dynamic enhancement signal for tail samples through decoupled mean-variance optimization. Furthermore, we design a distribution-guided contrastive learning mechanism that adaptively constructs positive and negative pairs based on the overlap between sample distributions, thereby alleviating feature looseness and cross-label semantic entanglement. Across visual and biological DIR benchmarks, DUO achieves the best few-shot bMAE and GM on IMDB-WIKI-DIR, AgeDB-DIR, and AAV2-DIR while remaining competitive on few-shot MAE.

📄 PDF Abstract BibTeX arXiv:2609.04995

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningActivity PredictionAge Estimation

Similar Papers 제목 키워드 기반

Equalization Loss v2: A New Gradient Balance Approach for Long-tailed Object Detection

2020-12-15 · CVPR 2021 1 · Jingru Tan, Xin Lu, Gang Zhang, Changqing Yin 외

Recently proposed decoupled training methods emerge as a dominant paradigm for long-tailed object detection. But they require an extra fine-tuning stage, and the disjointed optimization of representation and classifier m…

Instance SegmentationLong-tailed Object Detectionobject-detectionObject Detection

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading

2025-05-01 · Shuo Tong, Shangde Gao, Ke Liu, Zihang Huang 외

Automatic disease image grading is a significant application of artificial intelligence for healthcare, enabling faster and more accurate patient assessments. However, domain shifts, which are exacerbated by data imbalan…

Knowledge DistillationTransfer Learning

Uncertainty Voting Ensemble for Imbalanced Deep Regression

2023-05-24 · Yuchang Jiang, Vivien Sainte Fare Garnot, Konrad Schindler, Jan Dirk Wegner

Data imbalance is ubiquitous when applying machine learning to real-world problems, particularly regression problems. If training data are imbalanced, the learning is dominated by the densely covered regions of the targe…

Probabilistic Deep Learningregression

Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothing

2023-06-11 · NeurIPS 2023 11 · Ziyan Wang, Hao Wang

Existing regression models tend to fall short in both accuracy and uncertainty estimation when the label distribution is imbalanced. In this paper, we propose a probabilistic deep learning model, dubbed variational imbal…

Probabilistic Deep LearningregressionUncertainty Quantification

Accurate Prediction and Uncertainty Estimation using Decoupled Prediction Interval Networks

2022-02-19 · Kinjal Patel, Steven Waslander

We propose a network architecture capable of reliably estimating uncertainty of regression based predictions without sacrificing accuracy. The current state-of-the-art uncertainty algorithms either fall short of achievin…

Active LearningPredictionUncertainty Quantification