More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation
Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant features by adversarial training to reduce domain discrepancy, but they have two limits: 1) associations among pixels are not maintained, 2) the classifier trained on the source domain couldn't adapted well to the target. In this paper, we propose a new UDA semantic segmentation approach based on domain closeness assumption to alleviate the above problems. Specifically, a prototype clustering strategy is applied to cluster pixels with the same semantic, which will better maintain associations among target domain pixels during the feature alignment. After clustering, to make the classifier more adaptive, a normalized cut loss based on the affinity graph of the target domain is utilized, which will make the decision boundary target-specific. Sufficient experiments conducted on GTA5 $\rightarrow$ Cityscapes and SYNTHIA $\rightarrow$ Cityscapes proved the effectiveness of our method, which illustrated that our results achieved the new state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDomain AdaptationSegmentationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Separability is not the best goal for machine learning
Neural networks use their hidden layers to transform input data into linearly separable data clusters, with a linear or a perceptron type output layer making the final projection on the line perpendicular to the discrimi…
BIG-bench Machine LearningSparse Subspace Clustering Friendly Deep Dictionary Learning for Hyperspectral Image Classification
Subspace clustering techniques have shown promise in hyperspectral image segmentation. The fundamental assumption in subspace clustering is that the samples belonging to different clusters/segments lie in separable subsp…
ClusteringDictionary LearningHyperspectral Image Classificationhyperspectral image clustering+6Detecting Deepfake-Forged Contents with Separable Convolutional Neural Network and Image Segmentation
Recent advances in AI technology have made the forgery of digital images and videos easier, and it has become significantly more difficult to identify such forgeries. These forgeries, if disseminated with malicious inten…
Face SwappingImage SegmentationSemantic SegmentationStructured Reordering for Modeling Latent Alignments in Sequence Transduction
Despite success in many domains, neural models struggle in settings where train and test examples are drawn from different distributions. In particular, in contrast to humans, conventional sequence-to-sequence (seq2seq) …
Machine TranslationSemantic ParsingSystematic GeneralizationTranslationReconsidering Representation Alignment for Multi-view Clustering
Aligning distributions of view representations is a core component of today's state of the art models for deep multi-view clustering. However, we identify several drawbacks with na\"ively aligning representation distribu…
ClusteringContrastive Learning