paper-with-me

Papers

Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection

2025-09-25 · Duc-Tuan Truong, Tianchi Liu, Junjie Li, Ruijie Tao, Kong Aik Lee, Eng Siong Chng arxiv

In speech deepfake detection (SDD), data augmentation (DA) is commonly used to improve model generalization across varied speech conditions and spoofing attacks. However, during training, the backpropagated gradients from original and augmented inputs may misalign, which can result in conflicting parameter updates. These conflicts could hinder convergence and push the model toward suboptimal solutions, thereby reducing the benefits of DA. To investigate and address this issue, we design a dual-path data-augmented (DPDA) training framework with gradient alignment for SDD. In our framework, each training utterance is processed through two input paths: one using the original speech and the other with its augmented version. This design allows us to compare and align their backpropagated gradient directions to reduce optimization conflicts. Our analysis shows that approximately 25% of training iterations exhibit gradient conflicts between the original inputs and their augmented counterparts when using RawBoost augmentation. By resolving these conflicts with gradient alignment, our method accelerates convergence by reducing the number of training epochs and achieves up to an 18.69% relative reduction in Equal Error Rate on the In-the-Wild dataset compared to the baseline.

📄 PDF Abstract BibTeX arXiv:2509.20682

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake DetectionData Augmentation

Similar Papers 제목 키워드 기반

Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pretraining

2023-12-19 · Bumsoo Kim, Yeonsik Jo, Jinhyung Kim, Seung Hwan Kim

Contrastive Language-Image Pretraining has emerged as a prominent approach for training vision and text encoders with uncurated image-text pairs from the web. To enhance data-efficiency, recent efforts have introduced ad…

Image AugmentationMetric LearningRetrieval

Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pre-training

2023-01-01 · ICCV 2023 1 · Bumsoo Kim, Yeonsik Jo, Jinhyung Kim, Seunghwan Kim

Contrastive Language-Image Pretraining has emerged as a prominent approach for training vision and text encoders with uncurated image-text pairs from the web. To enhance data-efficiency, recent efforts have introduce…

Image AugmentationMetric LearningRetrieval

AGE: Adaptive-masking for Graph Embedding in Graph Retrieval-Augmented Generation

2026-06-30 · Bao Long Nguyen Huu, Atsushi Hashimoto hf

GraphRAG is an extension of retrieval-augmented generation (RAG) that supports large language models (LLMs) by referring to graph-structured data as external knowledge. While this technique ideally captures intricate rel…

Self-Supervised LearningGraph Embedding

Task-Specific Gradient Adaptation for Few-Shot One-Class Classification

2025-01-01 · CVPR 2025 1 · YunLong Li, Xiabi Liu, Liyuan Pan, Yuchen Ren

Optimization-based meta-learning methods for few-shot one-class classification (FS-OCC) aim to fine-tune a meta-trained model to classify the positive and negative samples using only a few positive samples by adaptat…

Meta-LearningOne-Class Classification

Disparate Impact in Differential Privacy from Gradient Misalignment

2022-06-15 · Maria S. Esipova, Atiyeh Ashari Ghomi, Yaqiao Luo, Jesse C. Cresswell

As machine learning becomes more widespread throughout society, aspects including data privacy and fairness must be carefully considered, and are crucial for deployment in highly regulated industries. Unfortunately, the …

Fairness