paper-with-me

Papers

Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separation

2023-11-20 · Chenyang Gao, Yue Gu, Ivan Marsic

In supervised speech separation, permutation invariant training (PIT) is widely used to handle label ambiguity by selecting the best permutation to update the model. Despite its success, previous studies showed that PIT is plagued by excessive label assignment switching in adjacent epochs, impeding the model to learn better label assignments. To address this issue, we propose a novel training strategy, dynamic sample dropout (DSD), which considers previous best label assignments and evaluation metrics to exclude the samples that may negatively impact the learned label assignments during training. Additionally, we include layer-wise optimization (LO) to improve the performance by solving layer-decoupling. Our experiments showed that combining DSD and LO outperforms the baseline and solves excessive label assignment switching and layer-decoupling issues. The proposed DSD and LO approach is easy to implement, requires no extra training sets or steps, and shows generality to various speech separation tasks.

📄 PDF Abstract BibTeX arXiv:2311.12199

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Separation

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Riemannian Patch Assignment Gradient Flows

2025-04-17 · Daniel Gonzalez-Alvarado, Fabio Schlindwein, Jonas Cassel, Laura Steingruber 외

This paper introduces patch assignment flows for metric data labeling on graphs. Labelings are determined by regularizing initial local labelings through the dynamic interaction of both labels and label assignments acros…

Numerical IntegrationUncertainty Quantification

Dropout can Simulate Exponential Number of Models for Sample Selection Techniques

2022-02-26 · Lakshya

Following Coteaching, generally in the literature, two models are used in sample selection based approaches for training with noisy labels. Meanwhile, it is also well known that Dropout when present in a network trains a…

Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples

2021-04-28 · ICCV 2021 10 · Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski 외

This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabele…

Image ClassificationPseudo LabelSemi-Supervised Image Classification

Interrupted and cascaded permutation invariant training for speech separation

2019-10-28 · Gene-Ping Yang, Szu-Lin Wu, Yao-Wen Mao, Hung-Yi Lee 외

Permutation Invariant Training (PIT) has long been a stepping stone method for training speech separation model in handling the label ambiguity problem. With PIT selecting the minimum cost label assignments dynamically, …

Speech Separation

Node Classification in Random Trees

2023-11-20 · Wouter W. L. Nuijten, Vlado Menkovski

We propose a method for the classification of objects that are structured as random trees. Our aim is to model a distribution over the node label assignments in settings where the tree data structure is associated with n…

ClassificationGraph Neural NetworkNode Classification