Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection
In speech deepfake detection (SDD), data augmentation (DA) is commonly used to improve model generalization across varied speech conditions and spoofing attacks. However, during training, the backpropagated gradients from original and augmented inputs may misalign, which can result in conflicting parameter updates. These conflicts could hinder convergence and push the model toward suboptimal solutions, thereby reducing the benefits of DA. To investigate and address this issue, we design a dual-path data-augmented (DPDA) training framework with gradient alignment for SDD. In our framework, each training utterance is processed through two input paths: one using the original speech and the other with its augmented version. This design allows us to compare and align their backpropagated gradient directions to reduce optimization conflicts. Our analysis shows that approximately 25% of training iterations exhibit gradient conflicts between the original inputs and their augmented counterparts when using RawBoost augmentation. By resolving these conflicts with gradient alignment, our method accelerates convergence by reducing the number of training epochs and achieves up to an 18.69% relative reduction in Equal Error Rate on the In-the-Wild dataset compared to the baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionData AugmentationSimilar Papers 제목 키워드 기반
Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pretraining
Contrastive Language-Image Pretraining has emerged as a prominent approach for training vision and text encoders with uncurated image-text pairs from the web. To enhance data-efficiency, recent efforts have introduced ad…
Image AugmentationMetric LearningRetrievalMisalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pre-training
Contrastive Language-Image Pretraining has emerged as a prominent approach for training vision and text encoders with uncurated image-text pairs from the web. To enhance data-efficiency, recent efforts have introduce…
Image AugmentationMetric LearningRetrievalAGE: Adaptive-masking for Graph Embedding in Graph Retrieval-Augmented Generation
GraphRAG is an extension of retrieval-augmented generation (RAG) that supports large language models (LLMs) by referring to graph-structured data as external knowledge. While this technique ideally captures intricate rel…
Self-Supervised LearningGraph EmbeddingTask-Specific Gradient Adaptation for Few-Shot One-Class Classification
Optimization-based meta-learning methods for few-shot one-class classification (FS-OCC) aim to fine-tune a meta-trained model to classify the positive and negative samples using only a few positive samples by adaptat…
Meta-LearningOne-Class ClassificationDisparate Impact in Differential Privacy from Gradient Misalignment
As machine learning becomes more widespread throughout society, aspects including data privacy and fairness must be carefully considered, and are crucial for deployment in highly regulated industries. Unfortunately, the …
Fairness