paper-with-me

홈 › Papers

Visualizing Adapted Knowledge in Domain Transfer

2021-04-20 · CVPR 2021 1 · Yunzhong Hou, Liang Zheng

A source model trained on source data and a target model learned through unsupervised domain adaptation (UDA) usually encode different knowledge. To understand the adaptation process, we portray their knowledge difference with image translation. Specifically, we feed a translated image and its original version to the two models respectively, formulating two branches. Through updating the translated image, we force similar outputs from the two branches. When such requirements are met, differences between the two images can compensate for and hence represent the knowledge difference between models. To enforce similar outputs from the two branches and depict the adapted knowledge, we propose a source-free image translation method that generates source-style images using only target images and the two models. We visualize the adapted knowledge on several datasets with different UDA methods and find that generated images successfully capture the style difference between the two domains. For application, we show that generated images enable further tuning of the target model without accessing source data. Code available at https://github.com/hou-yz/DA_visualization.

📄 PDF Abstract BibTeX arXiv:2104.10602

Code (1)

hou-yz/DA_visualization 공식 구현 pytorch

Tasks

Domain AdaptationExplainable artificial intelligenceTranslationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Visualizing Transferred Knowledge: An Interpretive Model of Unsupervised Domain Adaptation

2023-03-04 · Wenxiao Xiao, Zhengming Ding, Hongfu Liu

Many research efforts have been committed to unsupervised domain adaptation (DA) problems that transfer knowledge learned from a labeled source domain to an unlabeled target domain. Various DA methods have achieved remar…

Domain AdaptationUnsupervised Domain Adaptation

Impact of Domain-Adapted Multilingual Neural Machine Translation in the Medical Domain

2022-12-05 · Miguel Rios, Raluca-Maria Chereji, Alina Secara, Dragos Ciobanu

Multilingual Neural Machine Translation (MNMT) models leverage many language pairs during training to improve translation quality for low-resource languages by transferring knowledge from high-resource languages. We stud…

Machine TranslationTranslation

An Interactive Web-Interface for Visualizing the Inner Workings of the Question Answering LSTM

2018-11-01 · EMNLP 2018 11 · Ekaterina Loginova, G{\"u}nter Neumann

We present a visualisation tool which aims to illuminate the inner workings of an LSTM model for question answering. It plots heatmaps of neurons{'} firings and allows a user to check the dependency between neurons and m…

Feature EngineeringMachine TranslationQuestion Answering

TX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLP

2019-12-02 · Nils Rethmeier, Vageesh Kumar Saxena, Isabelle Augenstein

While state-of-the-art NLP explainability (XAI) methods focus on explaining per-sample decisions in supervised end or probing tasks, this is insufficient to explain and quantify model knowledge transfer during (un-)super…

Explainable Artificial Intelligence (XAI)Model CompressionTransfer Learning

CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency

2020-01-09 · CVPR 2019 6 · Yun-Chun Chen, Yen-Yu Lin, Ming-Hsuan Yang, Jia-Bin Huang

Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another (e.g., synthetic to real images). The adapted representations often do not capture pixel-level domain shifts that…

Data AugmentationDomain AdaptationImage-to-Image TranslationSemantic Segmentation+2