FREST: Feature RESToration for Semantic Segmentation under Multiple Adverse Conditions
Robust semantic segmentation under adverse conditions is crucial in real-world applications. To address this challenging task in practical scenarios where labeled normal condition images are not accessible in training, we propose FREST, a novel feature restoration framework for source-free domain adaptation (SFDA) of semantic segmentation to adverse conditions. FREST alternates two steps: (1) learning the condition embedding space that only separates the condition information from the features and (2) restoring features of adverse condition images on the learned condition embedding space. By alternating these two steps, FREST gradually restores features where the effect of adverse conditions is reduced. FREST achieved a state of the art on two public benchmarks (i.e., ACDC and RobotCar) for SFDA to adverse conditions. Moreover, it shows superior generalization ability on unseen datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSegmentationSemantic SegmentationSource-Free Domain AdaptationSimilar Papers 제목 키워드 기반
Restoration Adaptation for Semantic Segmentation on Low Quality Images
In real-world scenarios, the performance of semantic segmentation often deteriorates when processing low-quality (LQ) images, which may lack clear semantic structures and high-frequency details. Although image restoratio…
Semantic SegmentationImage ReconstructionImage SegmentationImage RestorationDecorrelating the Future: Joint Frequency Domain Learning for Spatio-temporal Forecasting
Standard direct forecasting models typically rely on point-wise objectives such as Mean Squared Error, which fail to capture the complex spatio-temporal dependencies inherent in graph-structured signals. While recent fre…
Cooperative Semantic Segmentation and Image Restoration in Adverse Environmental Conditions
Most state-of-the-art semantic segmentation approaches only achieve high accuracy in good conditions. In practically-common but less-discussed adverse environmental conditions, their performance can decrease enormously. …
Image RestorationScene ParsingSegmentationSemantic SegmentationUltra: Unsupervised Cross-Task Optimization for Reliable Restoration Segmentation Collaboration under Adverse Weather
Unsupervised Domain Adaptation for Adverse Weather Semantic Segmentation (UDA-ASS) aims to transfer semantic knowledge from labeled normal-weather images to unlabeled adverse environments. Existing approaches implicitly …
Unsupervised Domain AdaptationSemantic SegmentationObject DetectionVision-Language Controlled Deep Unfolding for Joint Medical Image Restoration and Segmentation
We propose VL-DUN, a principled framework for joint All-in-One Medical Image Restoration and Segmentation (AiOMIRS) that bridges the gap between low-level signal recovery and high-level semantic understanding. While stan…
Image Restoration