On the Road to Online Adaptation for Semantic Image Segmentation
We propose a new problem formulation and a corresponding evaluation framework to advance research on unsupervised domain adaptation for semantic image segmentation. The overall goal is fostering the development of adaptive learning systems that will continuously learn, without supervision, in ever-changing environments. Typical protocols that study adaptation algorithms for segmentation models are limited to few domains, adaptation happens offline, and human intervention is generally required, at least to annotate data for hyper-parameter tuning. We argue that such constraints are incompatible with algorithms that can continuously adapt to different real-world situations. To address this, we propose a protocol where models need to learn online, from sequences of temporally correlated images, requiring continuous, frame-by-frame adaptation. We accompany this new protocol with a variety of baselines to tackle the proposed formulation, as well as an extensive analysis of their behaviors, which can serve as a starting point for future research.
Code (1)
Tasks
Domain AdaptationImage SegmentationSegmentationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Survey
Semantic segmentation plays a fundamental role in a broad variety of computer vision applications, providing key information for the global understanding of an image. Yet, the state-of-the-art models rely on large amount…
Domain AdaptationDomain Generalizationimage-classificationImage Classification+7Semantic Image Segmentation: Two Decades of Research
Semantic image segmentation (SiS) plays a fundamental role in a broad variety of computer vision applications, providing key information for the global understanding of an image. This survey is an effort to summarize two…
Domain AdaptationDomain Generalizationimage-classificationImage Classification+11TransAdapt: A Transformative Framework for Online Test Time Adaptive Semantic Segmentation
Test-time adaptive (TTA) semantic segmentation adapts a source pre-trained image semantic segmentation model to unlabeled batches of target domain test images, different from real-world, where samples arrive one-by-one i…
SegmentationSemantic SegmentationTest-time AdaptationWe Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation
Manual visual inspection performed by certified inspectors is still the main form of road pothole detection. This process is, however, not only tedious, time-consuming and costly, but also dangerous for the inspectors. F…
Domain AdaptationSegmentationSemantic SegmentationThermal Image SegmentationOnline Continual Domain Adaptation for Semantic Image Segmentation Using Internal Representations
Semantic segmentation models trained on annotated data fail to generalize well when the input data distribution changes over extended time period, leading to requiring re-training to maintain performance. Classic Unsuper…
Domain AdaptationImage SegmentationSegmentationSemantic Segmentation+1