paper-with-me

홈 › Papers

End-to-End User-Defined Keyword Spotting using Shifted Delta Coefficients

2024-05-23 · Kesavaraj V, Anuprabha M, Anil Kumar Vuppala

Identifying user-defined keywords is crucial for personalizing interactions with smart devices. Previous approaches of user-defined keyword spotting (UDKWS) have relied on short-term spectral features such as mel frequency cepstral coefficients (MFCC) to detect the spoken keyword. However, these features may face challenges in accurately identifying closely related pronunciation of audio-text pairs, due to their limited capability in capturing the temporal dynamics of the speech signal. To address this challenge, we propose to use shifted delta coefficients (SDC) which help in capturing pronunciation variability (transition between connecting phonemes) by incorporating long-term temporal information. The performance of the SDC feature is compared with various baseline features across four different datasets using a cross-attention based end-to-end system. Additionally, various configurations of SDC are explored to find the suitable temporal context for the UDKWS task. The experimental results reveal that the SDC feature outperforms the MFCC baseline feature, exhibiting an improvement of 8.32% in area under the curve (AUC) and 8.69% in terms of equal error rate (EER) on the challenging Libriphrase-hard dataset. Moreover, the proposed approach demonstrated superior performance when compared to state-of-the-art UDKWS techniques.

📄 PDF Abstract BibTeX arXiv:2405.14489

Code (0)

등록된 구현이 없습니다.

Tasks

Keyword Spotting

Similar Papers 제목 키워드 기반

Metric Learning for User-defined Keyword Spotting

2022-11-01 · Jaemin Jung, Youkyum Kim, Jihwan Park, Youshin Lim 외

The goal of this work is to detect new spoken terms defined by users. While most previous works address Keyword Spotting (KWS) as a closed-set classification problem, this limits their transferability to unseen terms. Th…

Keyword SpottingMetric Learning

Few-Shot Keyword Spotting With Prototypical Networks

2020-07-25 · arXiv 2020 6 · Archit Parnami, Minwoo Lee

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learn…

Keyword SpottingMetric Learning

Personalized Keyword Spotting through Multi-task Learning

2022-06-28 · Seunghan Yang, Byeonggeun Kim, Inseop Chung, Simyung Chang

Keyword spotting (KWS) plays an essential role in enabling speech-based user interaction on smart devices, and conventional KWS (C-KWS) approaches have concentrated on detecting user-agnostic pre-defined keywords. Howeve…

Keyword SpottingMulti-Task LearningSpeaker Verification

SLiCK: Exploiting Subsequences for Length-Constrained Keyword Spotting

2024-09-06 · Kumari Nishu, Minsik Cho, Devang Naik

User-defined keyword spotting on a resource-constrained edge device is challenging. However, keywords are often bounded by a maximum keyword length, which has been largely under-leveraged in prior works. Our analysis of …

Keyword SpottingMulti-Task LearningPhoneme Recognition

Open-vocabulary Keyword-spotting with Adaptive Instance Normalization

2023-09-13 · Aviv Navon, Aviv Shamsian, Neta Glazer, Gill Hetz 외

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Keyword Spottingspeech-recognition+1