Domain Separation Networks
The cost of large scale data collection and annotation often makes the application of machine learning algorithms to new tasks or datasets prohibitively expensive. One approach circumventing this cost is training models on synthetic data where annotations are provided automatically. Despite their appeal, such models often fail to generalize from synthetic to real images, necessitating domain adaptation algorithms to manipulate these models before they can be successfully applied. Existing approaches focus either on mapping representations from one domain to the other, or on learning to extract features that are invariant to the domain from which they were extracted. However, by focusing only on creating a mapping or shared representation between the two domains, they ignore the individual characteristics of each domain. We suggest that explicitly modeling what is unique to each domain can improve a model's ability to extract domain-invariant features. Inspired by work on private-shared component analysis, we explicitly learn to extract image representations that are partitioned into two subspaces: one component which is private to each domain and one which is shared across domains. Our model is trained not only to perform the task we care about in the source domain, but also to use the partitioned representation to reconstruct the images from both domains. Our novel architecture results in a model that outperforms the state-of-the-art on a range of unsupervised domain adaptation scenarios and additionally produces visualizations of the private and shared representations enabling interpretation of the domain adaptation process.
Code (6)
Tasks
Domain AdaptationDomain GeneralizationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domain
The crux of single-channel speech separation is how to encode the mixture of signals into such a latent embedding space that the signals from different speakers can be precisely separated. Existing methods for speech sep…
speech-recognitionSpeech RecognitionSpeech SeparationA comprehensive study of speech separation: spectrogram vs waveform separation
Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network…
speech-recognitionSpeech RecognitionSpeech SeparationAdversarial Unsupervised Domain Adaptation for Harmonic-Percussive Source Separation
This paper addresses the problem of domain adaptation for the task of music source separation. Using datasets from two different domains, we compare the performance of a deep learning-based harmonic-percussive source sep…
Domain AdaptationMusic Source SeparationUnsupervised Domain AdaptationEnd-to-end training of time domain audio separation and recognition
The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based t…
Speaker Recognitionspeech-recognitionSpeech RecognitionSpeech SeparationRTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation
Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing stat…
Audio-Visual Speech Recognitionspeech-recognitionSpeech RecognitionSpeech Separation+1