Towards EMG-to-Speech with a Necklace Form Factor
Electrodes for decoding speech from electromyography (EMG) are typically placed on the face, requiring adhesives that are inconvenient and skin-irritating if used regularly. We explore a different device form factor, where dry electrodes are placed around the neck instead. 11-word, multi-speaker voiced EMG classifiers trained on data recorded with this device achieve 92.7% accuracy. Ablation studies reveal the importance of having more than two electrodes on the neck, and phonological analyses reveal similar classification confusions between neck-only and neck-and-face form factors. Finally, speech-EMG correlation experiments demonstrate a linear relationship between many EMG spectrogram frequency bins and self-supervised speech representation dimensions.
Code (0)
등록된 구현이 없습니다.
Tasks
Electromyography (EMG)FormSimilar Papers 제목 키워드 기반
The Complexity of Splitting Necklaces and Bisecting Ham Sandwiches
We resolve the computational complexity of two problems known as NECKLACE-SPLITTING and DISCRETE HAM SANDWICH, showing that they are PPA-complete. For NECKLACE SPLITTING, this result is specific to the important special …
Multi-site PPG: An In-the-Wild Physiological Dataset from Emerging Multi-site Wearables
Wearables are widely used for mobile health monitoring, and photoplethysmography (PPG) is a key sensing modality for heart rate and related physiological measurements. However, public in-the-wild PPG datasets remain larg…
Efficient Communication and Powering for Smart Contact Lens with Resonant Magneto-Quasistatic Coupling
A two-coil wearable system is proposed for wireless communication and powering between a transmitter coil in a necklace and a receiver coil in a smart contact lens, where the necklace is invisible in contrast to coils em…
NeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions
We present the design, implementation, and evaluation of a multi-sensor low-power necklace 'NeckSense' for automatically and unobtrusively capturing fine-grained information about an individual's eating activity and eati…
From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation
We present NeckSense, a novel wearable system for head pose tracking that leverages multi-channel bio-impedance sensing with soft, dry electrodes embedded in a lightweight, necklace-style form factor. NeckSense captures …
Head Pose EstimationPose EstimationPose Tracking