Visual Keyword Spotting
3개 벤치마크 · 논문 5편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
LipLearner: Customizable Silent Speech Interactions on Mobile Devices
Visual Keyword Spotting with Attention
Seeing wake words: Audio-visual Keyword Spotting
Zero-shot keyword spotting for visual speech recognition in-the-wild
Papers
Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical
On-device inference holds great potential for increased energy efficiency, responsiveness, and privacy in edge ML systems. However, due to less capable ML models that can be embedded in resource-limited devices, use case…
Gesture Recognitionimage-classificationImage ClassificationKeyword Spotting+1LipLearner: Customizable Silent Speech Interactions on Mobile Devices
Silent speech interface is a promising technology that enables private communications in natural language. However, previous approaches only support a small and inflexible vocabulary, which leads to limited expressivenes…
Contrastive LearningIncremental LearningKeyword SpottingLipreading+1Visual Keyword Spotting with Attention
In this paper, we consider the task of spotting spoken keywords in silent video sequences -- also known as visual keyword spotting. To this end, we investigate Transformer-based models that ingest two streams, a visual e…
Lip ReadingVisual Keyword SpottingSeeing wake words: Audio-visual Keyword Spotting
The goal of this work is to automatically determine whether and when a word of interest is spoken by a talking face, with or without the audio. We propose a zero-shot method suitable for in the wild videos. Our key contr…
Keyword SpottingLip ReadingVisual Keyword SpottingZero-shot keyword spotting for visual speech recognition in-the-wild
Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, p…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKeyword Spotting+4