t-RAIN: Robust generalization under weather-aliasing label shift attacks
In the classical supervised learning settings, classifiers are fit with the assumption of balanced label distributions and produce remarkable results on the same. In the real world, however, these assumptions often bend and in turn adversely impact model performance. Identifying bad learners in skewed target distributions is even more challenging. Thus achieving model robustness under these "label shift" settings is an important task in autonomous perception. In this paper, we analyze the impact of label shift on the task of multi-weather classification for autonomous vehicles. We use this information as a prior to better assess pedestrian detection in adverse weather. We model the classification performance as an indicator of robustness under 4 label shift scenarios and study the behavior of multiple classes of models. We propose t-RAIN a similarity mapping technique for synthetic data augmentation using large scale generative models and evaluate the performance on DAWN dataset. This mapping boosts model test accuracy by 2.1, 4.4, 1.9, 2.7 % in no-shift, fog, snow, dust shifts respectively. We present state-of-the-art pedestrian detection results on real and synthetic weather domains with best performing 82.69 AP (snow) and 62.31 AP (fog) respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesData AugmentationPedestrian DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Impact of Aliasing on Generalization in Deep Convolutional Networks
We investigate the impact of aliasing on generalization in Deep Convolutional Networks and show that data augmentation schemes alone are unable to prevent it due to structural limitations in widely used architectures. Dr…
Data AugmentationFew-Shot Learningimage-classificationImage ClassificationDouble Descent Optimization Pattern and Aliasing: Caveats of Noisy Labels
Optimization plays a key role in the training of deep neural networks. Deciding when to stop training can have a substantial impact on the performance of the network during inference. Under certain conditions, the genera…
(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Models
We introduce Mosaic, a probabilistic weather forecasting model that addresses three failure modes of spectral degradation in ML-based weather prediction: spectral damping (statistical), high-frequency aliasing (architect…
Weather ForecastingAliasing in Convnets: A Frame-Theoretic Perspective
Using a stride in a convolutional layer inherently introduces aliasing, which has implications for numerical stability and statistical generalization. While techniques such as the parametrizations via paraunitary systems…
Modeling Weather Uncertainty for Multi-weather Co-Presence Estimation
Images from outdoor scenes may be taken under various weather conditions. It is well studied that weather impacts the performance of computer vision algorithms and needs to be handled properly. However, existing algorith…
ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSemantic Segmentation