paper-with-me

홈 › Papers

Stochastic Adversarial Gradient Embedding for Active Domain Adaptation

2020-12-03 · Victor Bouvier, Philippe Very, Clément Chastagnol, Myriam Tami, Céline Hudelot

Unsupervised Domain Adaptation (UDA) aims to bridge the gap between a source domain, where labelled data are available, and a target domain only represented with unlabelled data. If domain invariant representations have dramatically improved the adaptability of models, to guarantee their good transferability remains a challenging problem. This paper addresses this problem by using active learning to annotate a small budget of target data. Although this setup, called Active Domain Adaptation (ADA), deviates from UDA's standard setup, a wide range of practical applications are faced with this situation. To this purpose, we introduce \textit{Stochastic Adversarial Gradient Embedding} (SAGE), a framework that makes a triple contribution to ADA. First, we select for annotation target samples that are likely to improve the representations' transferability by measuring the variation, before and after annotation, of the transferability loss gradient. Second, we increase sampling diversity by promoting different gradient directions. Third, we introduce a novel training procedure for actively incorporating target samples when learning invariant representations. SAGE is based on solid theoretical ground and validated on various UDA benchmarks against several baselines. Our empirical investigation demonstrates that SAGE takes the best of uncertainty \textit{vs} diversity samplings and improves representations transferability substantially.

📄 PDF Abstract BibTeX arXiv:2012.01843

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningDiversityDomain AdaptationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

ADA 설명 없음

Similar Papers 제목 키워드 기반

Effective Noise-aware Data Simulation for Domain-adaptive Speech Enhancement Leveraging Dynamic Stochastic Perturbation

2024-09-03 · Chien-Chun Wang, Li-Wei Chen, Hung-Shin Lee, Berlin Chen 외

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. T…

Speech Enhancement

May the Noise be with you: Adversarial Training without Adversarial Examples

2023-12-12 · Ayoub Arous, Andres F Lopez-Lopera, Nael Abu-Ghazaleh, Ihsen Alouani

In this paper, we investigate the following question: Can we obtain adversarially-trained models without training on adversarial examples? Our intuition is that training a model with inherent stochasticity, i.e., optimiz…

Stochastic Gradient Descent with Only One Projection

2012-12-01 · NeurIPS 2012 12 · Mehrdad Mahdavi, Tianbao Yang, Rong Jin, Shenghuo Zhu 외

Although many variants of stochastic gradient descent have been proposed for large-scale convex optimization, most of them require projecting the solution at {\it each} iteration to ensure that the obtained solution stay…

Multi-Adversarial Domain Adaptation

2018-09-04 · Zhongyi Pei, Zhangjie Cao, Mingsheng Long, Jian-Min Wang

Recent advances in deep domain adaptation reveal that adversarial learning can be embedded into deep networks to learn transferable features that reduce distribution discrepancy between the source and target domains. Exi…

Domain Adaptation

Gradient-Based Adversarial Factual Consistency Evaluation for Abstractive Summarization

2021-11-01 · EMNLP 2021 11 · Zhiyuan Zeng, Jiaze Chen, Weiran Xu, Lei LI

Neural abstractive summarization systems have gained significant progress in recent years. However, abstractive summarization often produce inconsisitent statements or false facts. How to automatically generate highly ab…

Abstractive Text SummarizationData Augmentation