Attention Consistency on Visual Corruptions for Single-Source Domain Generalization
Generalizing visual recognition models trained on a single distribution to unseen input distributions (i.e. domains) requires making them robust to superfluous correlations in the training set. In this work, we achieve this goal by altering the training images to simulate new domains and imposing consistent visual attention across the different views of the same sample. We discover that the first objective can be simply and effectively met through visual corruptions. Specifically, we alter the content of the training images using the nineteen corruptions of the ImageNet-C benchmark and three additional transformations based on Fourier transform. Since these corruptions preserve object locations, we propose an attention consistency loss to ensure that class activation maps across original and corrupted versions of the same training sample are aligned. We name our model Attention Consistency on Visual Corruptions (ACVC). We show that ACVC consistently achieves the state of the art on three single-source domain generalization benchmarks, PACS, COCO, and the large-scale DomainNet.
Code (1)
Tasks
Domain GeneralizationSingle-Source Domain GeneralizationSimilar Papers 제목 키워드 기반
$C^3$ASD: Multi-Level Consistency-Driven Representation Learning
Active Speaker Detection determines whether a visible person in a video is speaking at each moment. While recent audio-visual fusion methods perform well on clean data, they degrade under real-world corruptions such as b…
Active Speaker DetectionRepresentation LearningKnowledge DistillationContrastive LearningBenchmarking the Robustness of UAV Tracking Against Common Corruptions
The robustness of unmanned aerial vehicle (UAV) tracking is crucial in many tasks like surveillance and robotics. Despite its importance, little attention is paid to the performance of UAV trackers under common corruptio…
BenchmarkingClipTTT: CLIP-Guided Test-Time Training Helps LVLMs See Better
Large vision-language models (LVLMs) tend to hallucinate, especially when visual inputs are corrupted at test time. We show that such corruptions act as additional distribution shifts, significantly amplifying hallucinat…
Benchmarking the Robustness of Optical Flow Estimation to Corruptions
Optical flow estimation is extensively used in autonomous driving and video editing. While existing models demonstrate state-of-the-art performance across various benchmarks, the robustness of these methods has been infr…
Autonomous DrivingBenchmarkingOptical Flow EstimationVideo EditingMulti-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention
Most feedforward convolutional neural networks spend roughly the same efforts for each pixel. Yet human visual recognition is an interaction between eye movements and spatial attention, which we will have several glimpse…