Robust Regression via Deep Negative Correlation Learning
Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear regression to a robust loss function which is jointly optimizable with the deep convolutional network, and ii) utilizing ensemble of deep networks. Although some improved performance is achieved, the former may be lacking due to the intrinsic limitation of choosing a single hypothesis and the latter usually suffers from much larger computational complexity. To cope with those issues, we propose to regress via an efficient "divide and conquer" manner. The core of our approach is the generalization of negative correlation learning that has been shown, both theoretically and empirically, to work well for non-deep regression problems. Without extra parameters, the proposed method controls the bias-variance-covariance trade-off systematically and usually yields a deep regression ensemble where each base model is both "accurate" and "diversified". Moreover, we show that each sub-problem in the proposed method has less Rademacher Complexity and thus is easier to optimize. Extensive experiments on several diverse and challenging tasks including crowd counting, personality analysis, age estimation, and image super-resolution demonstrate the superiority over challenging baselines as well as the versatility of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Age EstimationCrowd CountingImage Super-ResolutionregressionSuper-ResolutionSimilar Papers 제목 키워드 기반
The Impact of Stocks on Correlations between Crop Yields and Prices and on Revenue Insurance Premiums using Semiparametric Quantile Regression
Crop yields and harvest prices are often considered to be negatively correlated, thus acting as a natural risk management hedge through stabilizing revenues. Storage theory gives reason to believe that the correlation is…
quantile regressionTrade Openness, Tariffs and Economic Growth: An Empirical Study from Countries of G-20
International trade has been in the forefront of economic development and growth debates. Trade openness, its definition, scope, and impacts have also been studied numerously. Tariff has been dubbed as negative influence…
regressionConvolutional Regression for Visual Tracking
Recently, discriminatively learned correlation filters (DCF) has drawn much attention in visual object tracking community. The success of DCF is potentially attributed to the fact that a large amount of samples are utili…
Object TrackingregressionVisual Object TrackingVisual TrackingACCon: Angle-Compensated Contrastive Regularizer for Deep Regression
In deep regression, capturing the relationship among continuous labels in feature space is a fundamental challenge that has attracted increasing interest. Addressing this issue can prevent models from converging to subop…
Contrastive LearningregressionRepresentation LearningFully Bayesian inference for neural models with negative-binomial spiking
Characterizing the information carried by neural populations in the brain requires accurate statistical models of neural spike responses. The negative-binomial distribution provides a convenient model for over-dispersed…
Bayesian InferenceData Augmentationregression