Leveraging Contrastive Learning for Semantic Segmentation with Consistent Labels Across Varying Appearances
This paper introduces a novel synthetic dataset that captures urban scenes under a variety of weather conditions, providing pixel-perfect, ground-truth-aligned images to facilitate effective feature alignment across domains. Additionally, we propose a method for domain adaptation and generalization that takes advantage of the multiple versions of each scene, enforcing feature consistency across different weather scenarios. Our experimental results demonstrate the impact of our dataset in improving performance across several alignment metrics, addressing key challenges in domain adaptation and generalization for segmentation tasks. This research also explores critical aspects of synthetic data generation, such as optimizing the balance between the volume and variability of generated images to enhance segmentation performance. Ultimately, this work sets forth a new paradigm for synthetic data generation and domain adaptation.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDomain AdaptationSegmentationSemantic SegmentationSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Looking Beyond Single Images for Contrastive Semantic Segmentation Learning
We present an approach to contrastive representation learning for semantic segmentation. Our approach leverages the representational power of existing feature extractors to find corresponding regions across images. These…
Contrastive Learningimage-classificationImage ClassificationRepresentation Learning+3Bootstrapping Semantic Segmentation with Regional Contrast
We present ReCo, a contrastive learning framework designed at a regional level to assist learning in semantic segmentation. ReCo performs semi-supervised or supervised pixel-level contrastive learning on a sparse set of …
Contrastive LearningSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSemantic-Aware Contrastive Learning for Multi-object Medical Image Segmentation
Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this …
Contrastive LearningDecoderImage ClassificationImage Segmentation+3CLUDA : Contrastive Learning in Unsupervised Domain Adaptation for Semantic Segmentation
In this work, we propose CLUDA, a simple, yet novel method for performing unsupervised domain adaptation (UDA) for semantic segmentation by incorporating contrastive losses into a student-teacher learning paradigm, that …
Contrastive LearningDomain AdaptationSegmentationSemantic Segmentation+2TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding
3D Gaussian Splatting (3DGS) has emerged as a real-time, differentiable representation for neural scene understanding. However, existing 3DGS-based methods struggle to represent hierarchical 3D semantic structures and ca…
Contrastive LearningScene UnderstandingScene Segmentation