An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio
When the task of locating manipulation regions in partially-fake audio (PFA) involves cross-domain datasets, the performance of deep learning models drops significantly due to the shift between the source and target domains. To address this issue, existing approaches often employ data augmentation before training. However, they overlook the characteristics in target domain that are absent in source domain. Inspired by the mixture-of-experts model, we propose an unsupervised method named Samples mining with Diversity and Entropy (SDE). Our method first learns from a collection of diverse experts that achieve great performance from different perspectives in the source domain, but with ambiguity on target samples. We leverage these diverse experts to select the most informative samples by calculating their entropy. Furthermore, we introduced a label generation method tailored for these selected samples that are incorporated in the training process in source domain integrating the target domain information. We applied our method to a cross-domain partially fake audio detection dataset, ADD2023Track2. By introducing 10% of unknown samples from the target domain, we achieved an F1 score of 43.84%, which represents a relative increase of 77.2% compared to the second-best method.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversityDomain AdaptationMixture-of-ExpertsUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltales
The technological advancements of deep learning have enabled sophisticated face manipulation schemes, raising severe trust issues and security concerns in modern society. Generally speaking, detecting manipulated faces a…
Decision MakingMulti-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos
Detecting manipulated images and videos is an important topic in digital media forensics. Most detection methods use binary classification to determine the probability of a query being manipulated. Another important topi…
Binary ClassificationDecoderFace SwappingGeneral Classification+1Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models
Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the trainin…
Domain Adaptationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1SMC-UDA: Structure-Modal Constraint for Unsupervised Cross-Domain Renal Segmentation
Medical image segmentation based on deep learning often fails when deployed on images from a different domain. The domain adaptation methods aim to solve domain-shift challenges, but still face some problems. The transfe…
Domain AdaptationImage SegmentationMedical Image SegmentationSegmentation+4Instance Adaptive Self-Training for Unsupervised Domain Adaptation
The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such a problem. Recent works show…
Domain AdaptationImage-to-Image TranslationPseudo LabelSemantic Segmentation+2