paper-with-me

홈 › Papers

Personalized Speech recognition on mobile devices

2016-03-10 · Ian McGraw, Rohit Prabhavalkar, Raziel Alvarez, Montse Gonzalez Arenas, Kanishka Rao, David Rybach, Ouais Alsharif, Hasim Sak, Alexander Gruenstein, Francoise Beaufays, Carolina Parada

We describe a large vocabulary speech recognition system that is accurate, has low latency, and yet has a small enough memory and computational footprint to run faster than real-time on a Nexus 5 Android smartphone. We employ a quantized Long Short-Term Memory (LSTM) acoustic model trained with connectionist temporal classification (CTC) to directly predict phoneme targets, and further reduce its memory footprint using an SVD-based compression scheme. Additionally, we minimize our memory footprint by using a single language model for both dictation and voice command domains, constructed using Bayesian interpolation. Finally, in order to properly handle device-specific information, such as proper names and other context-dependent information, we inject vocabulary items into the decoder graph and bias the language model on-the-fly. Our system achieves 13.5% word error rate on an open-ended dictation task, running with a median speed that is seven times faster than real-time.

📄 PDF Abstract BibTeX arXiv:1603.03185

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderLanguage ModelingLanguage Modellingspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices

2024-04-24 · Gwantae Kim, Bokyeung Lee, Donghyeon Kim, Hanseok Ko

In recent times, there has been a growing interest in utilizing personalized large models on low-spec devices, such as mobile and CPU-only devices. However, utilizing a personalized large model in the on-device is ineffi…

Automatic Speech RecognitionCPUparameter-efficient fine-tuningspeech-recognition+1

UserLibri: A Dataset for ASR Personalization Using Only Text

2022-07-02 · Theresa Breiner, Swaroop Ramaswamy, Ehsan Variani, Shefali Garg 외

Personalization of speech models on mobile devices (on-device personalization) is an active area of research, but more often than not, mobile devices have more text-only data than paired audio-text data. We explore train…

Language ModelingLanguage Modellingspeech-recognitionSpeech Recognition

An Investigation Into On-device Personalization of End-to-end Automatic Speech Recognition Models

2019-09-14 · Khe Chai Sim, Petr Zadrazil, Françoise Beaufays

Speaker-independent speech recognition systems trained with data from many users are generally robust against speaker variability and work well for a large population of speakers. However, these systems do not always gen…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Personalization of End-to-end Speech Recognition On Mobile Devices For Named Entities

2019-12-14 · Khe Chai Sim, Françoise Beaufays, Arnaud Benard, Dhruv Guliani 외

We study the effectiveness of several techniques to personalize end-to-end speech models and improve the recognition of proper names relevant to the user. These techniques differ in the amounts of user effort required to…

speech-recognitionSpeech Recognition

persoDA: Personalized Data Augmentation for Personalized ASR

2025-01-15 · Pablo Peso Parada, Spyros Fontalis, Md Asif Jalal, Karthikeyan Saravanan 외

Data augmentation (DA) is ubiquitously used in training of Automatic Speech Recognition (ASR) models. DA offers increased data variability, robustness and generalization against different acoustic distortions. Recently, …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentationspeech-recognition+1