Graph Convolutional Network Based Semi-Supervised Learning on Multi-Speaker Meeting Data
Unsupervised clustering on speakers is becoming increasingly important for its potential uses in semi-supervised learning. In reality, we are often presented with enormous amounts of unlabeled data from multi-party meetings and discussions. An effective unsupervised clustering approach would allow us to significantly increase the amount of training data without additional costs for annotations. Recently, methods based on graph convolutional networks (GCN) have received growing attention for unsupervised clustering, as these methods exploit the connectivity patterns between nodes to improve learning performance. In this work, we present a GCN-based approach for semi-supervised learning. Given a pre-trained embedding extractor, a graph convolutional network is trained on the labeled data and clusters unlabeled data with "pseudo-labels". We present a self-correcting training mechanism that iteratively runs the cluster-train-correct process on pseudo-labels. We show that this proposed approach effectively uses unlabeled data and improves speaker recognition accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringSpeaker RecognitionSimilar Papers 제목 키워드 기반
Graph-based Label Propagation for Semi-Supervised Speaker Identification
Speaker identification in the household scenario (e.g., for smart speakers) is typically based on only a few enrollment utterances but a much larger set of unlabeled data, suggesting semisupervised learning to improve sp…
Speaker IdentificationSpeaker RecognitionSpeaker attribution with voice profiles by graph-based semi-supervised learning
Speaker attribution is required in many real-world applications, such as meeting transcription, where speaker identity is assigned to each utterance according to speaker voice profiles. In this paper, we propose to solve…
Speaker IdentificationSemi-supervised Acoustic Modelling for Five-lingual Code-switched ASR using Automatically-segmented Soap Opera Speech
This paper considers the impact of automatic segmentation on the fully-automatic, semi-supervised training of automatic speech recog-nition (ASR) systems for five-lingual code-switched (CS) speech. Four automatic segment…
Acoustic ModellingAction DetectionActivity DetectionSegmentation+2Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation
Recently, end-to-end multi-speaker text-to-speech (TTS) systems gain success in the situation where a lot of high-quality speech plus their corresponding transcriptions are available. However, laborious paired data colle…
DecoderSpeech Synthesistext-to-speechText to Speech+1Structure fusion based on graph convolutional networks for semi-supervised classification
Suffering from the multi-view data diversity and complexity for semi-supervised classification, most of existing graph convolutional networks focus on the networks architecture construction or the salient graph structure…
ClassificationGeneral ClassificationNode ClassificationSpecificity