Network Architecture Search for Domain Adaptation
Deep networks have been used to learn transferable representations for domain adaptation. Existing deep domain adaptation methods systematically employ popular hand-crafted networks designed specifically for image-classification tasks, leading to sub-optimal domain adaptation performance. In this paper, we present Neural Architecture Search for Domain Adaptation (NASDA), a principle framework that leverages differentiable neural architecture search to derive the optimal network architecture for domain adaptation task. NASDA is designed with two novel training strategies: neural architecture search with multi-kernel Maximum Mean Discrepancy to derive the optimal architecture, and adversarial training between a feature generator and a batch of classifiers to consolidate the feature generator. We demonstrate experimentally that NASDA leads to state-of-the-art performance on several domain adaptation benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain Adaptationimage-classificationImage ClassificationNeural Architecture SearchSimilar Papers 제목 키워드 기반
AutoAdapt: Automated Segmentation Network Search for Unsupervised Domain Adaptation
Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods ha…
Domain AdaptationNeural Architecture SearchSemantic SegmentationUnsupervised Domain AdaptationDomain Adaptation by Maximizing Population Correlation with Neural Architecture Search
In Domain Adaptation (DA), where the feature distributions of the source and target domains are different, various distance-based methods have been proposed to minimize the discrepancy between the source and target domai…
Domain AdaptationNeural Architecture SearchDomain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey
The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating t…
Domain AdaptationMachine TranslationNMTTranslationLeveraging the Domain Adaptation of Retrieval Augmented Generation Models for Question Answering and Reducing Hallucination
While ongoing advancements in Large Language Models have demonstrated remarkable success across various NLP tasks, Retrieval Augmented Generation Model stands out to be highly effective on downstream applications like Qu…
Domain AdaptationHallucinationQuestion AnsweringRAG+1Slimmable Domain Adaptation
Vanilla unsupervised domain adaptation methods tend to optimize the model with fixed neural architecture, which is not very practical in real-world scenarios since the target data is usually processed by different resour…
Domain AdaptationDomain GeneralizationUnsupervised Domain Adaptation