Visualizing Adapted Knowledge in Domain Transfer
A source model trained on source data and a target model learned through unsupervised domain adaptation (UDA) usually encode different knowledge. To understand the adaptation process, we portray their knowledge difference with image translation. Specifically, we feed a translated image and its original version to the two models respectively, formulating two branches. Through updating the translated image, we force similar outputs from the two branches. When such requirements are met, differences between the two images can compensate for and hence represent the knowledge difference between models. To enforce similar outputs from the two branches and depict the adapted knowledge, we propose a source-free image translation method that generates source-style images using only target images and the two models. We visualize the adapted knowledge on several datasets with different UDA methods and find that generated images successfully capture the style difference between the two domains. For application, we show that generated images enable further tuning of the target model without accessing source data. Code available at https://github.com/hou-yz/DA_visualization.
Code (1)
Tasks
Domain AdaptationExplainable artificial intelligenceTranslationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Visualizing Transferred Knowledge: An Interpretive Model of Unsupervised Domain Adaptation
Many research efforts have been committed to unsupervised domain adaptation (DA) problems that transfer knowledge learned from a labeled source domain to an unlabeled target domain. Various DA methods have achieved remar…
Domain AdaptationUnsupervised Domain AdaptationImpact of Domain-Adapted Multilingual Neural Machine Translation in the Medical Domain
Multilingual Neural Machine Translation (MNMT) models leverage many language pairs during training to improve translation quality for low-resource languages by transferring knowledge from high-resource languages. We stud…
Machine TranslationTranslationAn Interactive Web-Interface for Visualizing the Inner Workings of the Question Answering LSTM
We present a visualisation tool which aims to illuminate the inner workings of an LSTM model for question answering. It plots heatmaps of neurons{'} firings and allows a user to check the dependency between neurons and m…
Feature EngineeringMachine TranslationQuestion AnsweringTX-Ray: Quantifying and Explaining Model-Knowledge Transfer in (Un-)Supervised NLP
While state-of-the-art NLP explainability (XAI) methods focus on explaining per-sample decisions in supervised end or probing tasks, this is insufficient to explain and quantify model knowledge transfer during (un-)super…
Explainable Artificial Intelligence (XAI)Model CompressionTransfer LearningCrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency
Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another (e.g., synthetic to real images). The adapted representations often do not capture pixel-level domain shifts that…
Data AugmentationDomain AdaptationImage-to-Image TranslationSemantic Segmentation+2