paper-with-me

홈 › Papers

Domain Separation Networks

2016-08-22 · NeurIPS 2016 12 · Konstantinos Bousmalis, George Trigeorgis, Nathan Silberman, Dilip Krishnan, Dumitru Erhan

The cost of large scale data collection and annotation often makes the application of machine learning algorithms to new tasks or datasets prohibitively expensive. One approach circumventing this cost is training models on synthetic data where annotations are provided automatically. Despite their appeal, such models often fail to generalize from synthetic to real images, necessitating domain adaptation algorithms to manipulate these models before they can be successfully applied. Existing approaches focus either on mapping representations from one domain to the other, or on learning to extract features that are invariant to the domain from which they were extracted. However, by focusing only on creating a mapping or shared representation between the two domains, they ignore the individual characteristics of each domain. We suggest that explicitly modeling what is unique to each domain can improve a model's ability to extract domain-invariant features. Inspired by work on private-shared component analysis, we explicitly learn to extract image representations that are partitioned into two subspaces: one component which is private to each domain and one which is shared across domains. Our model is trained not only to perform the task we care about in the source domain, but also to use the partitioned representation to reconstruct the images from both domains. Our novel architecture results in a model that outperforms the state-of-the-art on a range of unsupervised domain adaptation scenarios and additionally produces visualizations of the private and shared representations enabling interpretation of the domain adaptation process.

📄 PDF Abstract BibTeX arXiv:1608.06019

Code (6)

tensorflow/models 공식 구현 tf
AmirHussein96/Simplified-DSN tf
WinChua/CDRTR tf
better-chao/DSN pytorch
fungtion/DSN pytorch
tensorflow/models/tree/master/research/domain_adaptation tf

Tasks

Domain AdaptationDomain GeneralizationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domain

2021-10-10 · Zengwei Yao, Wenjie Pei, Fanglin Chen, Guangming Lu 외

The crux of single-channel speech separation is how to encode the mixture of signals into such a latent embedding space that the signals from different speakers can be precisely separated. Existing methods for speech sep…

speech-recognitionSpeech RecognitionSpeech Separation

A comprehensive study of speech separation: spectrogram vs waveform separation

2019-05-17 · Fahimeh Bahmaninezhad, Jian Wu, Rongzhi Gu, Shi-Xiong Zhang 외

Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network…

speech-recognitionSpeech RecognitionSpeech Separation

Adversarial Unsupervised Domain Adaptation for Harmonic-Percussive Source Separation

2021-01-03 · Carlos Lordelo, Emmanouil Benetos, Simon Dixon, Sven Ahlbäck 외

This paper addresses the problem of domain adaptation for the task of music source separation. Using datasets from two different domains, we compare the performance of a deep learning-based harmonic-percussive source sep…

Domain AdaptationMusic Source SeparationUnsupervised Domain Adaptation

End-to-end training of time domain audio separation and recognition

2019-12-18 · Thilo von Neumann, Keisuke Kinoshita, Lukas Drude, Christoph Boeddeker 외

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based t…

Speaker Recognitionspeech-recognitionSpeech RecognitionSpeech Separation

RTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation

2023-09-29 · Samuel Pegg, Kai Li, Xiaolin Hu

Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing stat…

Audio-Visual Speech Recognitionspeech-recognitionSpeech RecognitionSpeech Separation+1