paper-with-me

Papers

A Comparison of Semi-Supervised Learning Techniques for Streaming ASR at Scale

2023-04-19 · Cal Peyser, Michael Picheny, Kyunghyun Cho, Rohit Prabhavalkar, Ronny Huang, Tara Sainath

Unpaired text and audio injection have emerged as dominant methods for improving ASR performance in the absence of a large labeled corpus. However, little guidance exists on deploying these methods to improve production ASR systems that are trained on very large supervised corpora and with realistic requirements like a constrained model size and CPU budget, streaming capability, and a rich lattice for rescoring and for downstream NLU tasks. In this work, we compare three state-of-the-art semi-supervised methods encompassing both unpaired text and audio as well as several of their combinations in a controlled setting using joint training. We find that in our setting these methods offer many improvements beyond raw WER, including substantial gains in tail-word WER, decoder computation during inference, and lattice density.

📄 PDF Abstract BibTeX arXiv:2304.11053

Code (0)

등록된 구현이 없습니다.

Tasks

CPUDecoder

Similar Papers 제목 키워드 기반

Abuse and Fraud Detection in Streaming Services Using Heuristic-Aware Machine Learning

2022-03-04 · Soheil Esmaeilzadeh, Negin Salajegheh, Amir Ziai, Jeff Boote

This work presents a fraud and abuse detection framework for streaming services by modeling user streaming behavior. The goal is to discover anomalous and suspicious incidents and scale the investigation efforts by creat…

Abuse DetectionAnomaly DetectionBIG-bench Machine LearningBinary Classification+7

Fixed-Rank Approximation of a Positive-Semidefinite Matrix from Streaming Data

2017-06-18 · NeurIPS 2017 12 · Joel A. Tropp, Alp Yurtsever, Madeleine Udell, Volkan Cevher

Several important applications, such as streaming PCA and semidefinite programming, involve a large-scale positive-semidefinite (psd) matrix that is presented as a sequence of linear updates. Because of storage limitatio…

Large Scale Distributed Semi-Supervised Learning Using Streaming Approximation

2015-12-06 · Sujith Ravi, Qiming Diao

Traditional graph-based semi-supervised learning (SSL) approaches, even though widely applied, are not suited for massive data and large label scenarios since they scale linearly with the number of edges $|E|$ and distin…

graph construction

StreamHear: Domain-Adapted Pseudo-Labeling for Semi-Supervised Streaming Speech Recognition

2026-08-13 · Zefang Liu, Chenyang Zhu, Sangwoo Cho, Xujun Peng 외 arxiv

Streaming automatic speech recognition (ASR) underperforms on domain-shifted target audio, where labeled in-domain data is costly to prepare while unlabeled audio is abundant. We present StreamHear, a semi-supervised pip…

Speech Recognition

Semi-Supervised Segmentation of Multi-vendor and Multi-center Cardiac MRI

2021-05-09 · IEEE 2021 5 · Mahyar Bolhassani; Ilkay Oksuz

Automatic segmentation of the heart cavity is an essential task for the diagnosis of cardiac diseases. In this paper, we propose a semi-supervised segmentation setup for leveraging unlabeled data to segment Left-ventricl…

2D Semantic SegmentationSegmentation