paper-with-me

Papers

Semantic Segmentation in Multiple Adverse Weather Conditions with Domain Knowledge Retention

2024-01-15 · Xin Yang, Wending Yan, Yuan Yuan, Michael Bi Mi, Robby T. Tan

Semantic segmentation's performance is often compromised when applied to unlabeled adverse weather conditions. Unsupervised domain adaptation is a potential approach to enhancing the model's adaptability and robustness to adverse weather. However, existing methods encounter difficulties when sequentially adapting the model to multiple unlabeled adverse weather conditions. They struggle to acquire new knowledge while also retaining previously learned knowledge.To address these problems, we propose a semantic segmentation method for multiple adverse weather conditions that incorporates adaptive knowledge acquisition, pseudolabel blending, and weather composition replay. Our adaptive knowledge acquisition enables the model to avoid learning from extreme images that could potentially cause the model to forget. In our approach of blending pseudo-labels, we not only utilize the current model but also integrate the previously learned model into the ongoing learning process. This collaboration between the current teacher and the previous model enhances the robustness of the pseudo-labels for the current target. Our weather composition replay mechanism allows the model to continuously refine its previously learned weather information while simultaneously learning from the new target domain. Our method consistently outperforms the stateof-the-art methods, and obtains the best performance with averaged mIoU (%) of 65.7 and the lowest forgetting (%) of 3.6 against 60.1 and 11.3, on the ACDC datasets for a four-target continual multi-target domain adaptation.

📄 PDF Abstract BibTeX arXiv:2401.07459

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationMulti-target Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weather

2024-07-02 · Junsung Park, KyungMin Kim, Hyunjung Shim

Existing LiDAR semantic segmentation methods often struggle with performance declines in adverse weather conditions. Previous work has addressed this issue by simulating adverse weather or employing universal data augmen…

Data AugmentationLIDAR Semantic SegmentationQ-LearningSemantic Segmentation

Semantic Segmentation under Adverse Conditions: A Weather and Nighttime-aware Synthetic Data-based Approach

2022-10-11 · Abdulrahman Kerim, Felipe Chamone, Washington Ramos, Leandro Soriano Marcolino 외

Recent semantic segmentation models perform well under standard weather conditions and sufficient illumination but struggle with adverse weather conditions and nighttime. Collecting and annotating training data under the…

Domain AdaptationMulti-Task LearningSegmentationSemantic Segmentation

When Cars meet Drones: Hyperbolic Federated Learning for Source-Free Domain Adaptation in Adverse Weather

2024-03-20 · Giulia Rizzoli, Matteo Caligiuri, Donald Shenaj, Francesco Barbato 외

In Federated Learning (FL), multiple clients collaboratively train a global model without sharing private data. In semantic segmentation, the Federated source Free Domain Adaptation (FFreeDA) setting is of particular int…

Autonomous VehiclesDomain AdaptationFederated LearningSegmentation+2

WeatherProof: Leveraging Language Guidance for Semantic Segmentation in Adverse Weather

2024-03-21 · Blake Gella, Howard Zhang, Rishi Upadhyay, Tiffany Chang 외

We propose a method to infer semantic segmentation maps from images captured under adverse weather conditions. We begin by examining existing models on images degraded by weather conditions such as rain, fog, or snow, an…

Semantic Segmentation

WeatherProof: A Paired-Dataset Approach to Semantic Segmentation in Adverse Weather

2023-12-15 · Blake Gella, Howard Zhang, Rishi Upadhyay, Tiffany Chang 외

The introduction of large, foundational models to computer vision has led to drastically improved performance on the task of semantic segmentation. However, these existing methods exhibit a large performance drop when te…

SegmentationSemantic Segmentation