paper-with-me

홈 › Papers

DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation

2023-04-05 · CVPR 2023 1 · Fengyi Shen, Akhil Gurram, Ziyuan Liu, He Wang, Alois Knoll

Domain adaptive semantic segmentation methods commonly utilize stage-wise training, consisting of a warm-up and a self-training stage. However, this popular approach still faces several challenges in each stage: for warm-up, the widely adopted adversarial training often results in limited performance gain, due to blind feature alignment; for self-training, finding proper categorical thresholds is very tricky. To alleviate these issues, we first propose to replace the adversarial training in the warm-up stage by a novel symmetric knowledge distillation module that only accesses the source domain data and makes the model domain generalizable. Surprisingly, this domain generalizable warm-up model brings substantial performance improvement, which can be further amplified via our proposed cross-domain mixture data augmentation technique. Then, for the self-training stage, we propose a threshold-free dynamic pseudo-label selection mechanism to ease the aforementioned threshold problem and make the model better adapted to the target domain. Extensive experiments demonstrate that our framework achieves remarkable and consistent improvements compared to the prior arts on popular benchmarks. Codes and models are available at https://github.com/fy-vision/DiGA

📄 PDF Abstract BibTeX arXiv:2304.02222

Code (1)

fy-vision/diga 공식 구현 pytorch

Tasks

Data AugmentationKnowledge DistillationPseudo LabelSemantic Segmentation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

How and When Adversarial Robustness Transfers in Knowledge Distillation?

2021-10-22 · Rulin Shao, JinFeng Yi, Pin-Yu Chen, Cho-Jui Hsieh

Knowledge distillation (KD) has been widely used in teacher-student training, with applications to model compression in resource-constrained deep learning. Current works mainly focus on preserving the accuracy of the tea…

Adversarial RobustnessKnowledge DistillationModel Compression

Dynamically Instance-Guided Adaptation: A Backward-Free Approach for Test-Time Domain Adaptive Semantic Segmentation

2023-01-01 · CVPR 2023 1 · Wei Wang, Zhun Zhong, Weijie Wang, Xi Chen 외

In this paper, we study the application of Test-time domain adaptation in semantic segmentation (TTDA-Seg) where both efficiency and effectiveness are crucial. Existing methods either have low efficiency (e.g., backw…

Domain AdaptationSemantic Segmentation

DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpainting

2025-07-01 · Jingyi Pan, Dan Xu, Qiong Luo arxiv

Developing a unified pipeline that enables users to remove, re-texture, or replace objects in a versatile manner is crucial for text-guided 3D inpainting. However, there are still challenges in performing multiple 3D inp…

medigan: a Python library of pretrained generative models for medical image synthesis

2022-09-28 · Richard Osuala, Grzegorz Skorupko, Noussair Lazrak, Lidia Garrucho 외

Synthetic data generated by generative models can enhance the performance and capabilities of data-hungry deep learning models in medical imaging. However, there is (1) limited availability of (synthetic) datasets and (2…

Generative Adversarial NetworkImage Generation

DiGamma: Domain-aware Genetic Algorithm for HW-Mapping Co-optimization for DNN Accelerators

2022-01-26 · Sheng-Chun Kao, Michael Pellauer, Angshuman Parashar, Tushar Krishna

The design of DNN accelerators includes two key parts: HW resource configuration and mapping strategy. Intensive research has been conducted to optimize each of them independently. Unfortunately, optimizing for both toge…