All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation
In this paper we tackle the problem of unsupervised domain adaptation for the task of semantic segmentation, where we attempt to transfer the knowledge learned upon synthetic datasets with ground-truth labels to real-world images without any annotation. With the hypothesis that the structural content of images is the most informative and decisive factor to semantic segmentation and can be readily shared across domains, we propose a Domain Invariant Structure Extraction (DISE) framework to disentangle images into domain-invariant structure and domain-specific texture representations, which can further realize image-translation across domains and enable label transfer to improve segmentation performance. Extensive experiments verify the effectiveness of our proposed DISE model and demonstrate its superiority over several state-of-the-art approaches.
Code (1)
Tasks
AllDomain AdaptationImage-to-Image TranslationSegmentationSemantic SegmentationSynthetic-to-Real TranslationTranslationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Causal-aware Large Language Models: Enhancing Decision-Making Through Learning, Adapting and Acting
Large language models (LLMs) have shown great potential in decision-making due to the vast amount of knowledge stored within the models. However, these pre-trained models are prone to lack reasoning abilities and are dif…
Decision MakingArtificial intelligence techniques for integrative structural biology of intrinsically disordered proteins
We outline recent developments in artificial intelligence (AI) and machine learning (ML) techniques for integrative structural biology of intrinsically disordered proteins (IDP) ensembles. IDPs challenge the traditional …
USBD: Universal Structural Basis Distillation for Source-Free Graph Domain Adaptation
SF-GDA is pivotal for privacy-preserving knowledge transfer across graph datasets. Although recent works incorporate structural information, they implicitly condition adaptation on the smoothness priors of sourcetrained …
Computational EfficiencyGRAPH DOMAIN ADAPTATIONProtSent: Protein Sentence Transformers
Protein language models (pLMs) produce per-residue representations that capture evolutionary and structural information, yet their mean-pooled sequence embeddings are not explicitly trained to reflect functional, evoluti…
Incorporating prior knowledge about structural constraints in model identification
Model identification is a crucial problem in chemical industries. In recent years, there has been increasing interest in learning data-driven models utilizing partial knowledge about the system of interest. Most techniqu…