paper-with-me

Papers

Multi-Microphone Noise Data Augmentation for DNN-based Own Voice Reconstruction for Hearables in Noisy Environments

2023-12-14 · Mattes Ohlenbusch, Christian Rollwage, Simon Doclo

Hearables with integrated microphones may offer communication benefits in noisy working environments, e.g. by transmitting the recorded own voice of the user. Systems aiming at reconstructing the clean and full-bandwidth own voice from noisy microphone recordings are often based on supervised learning. Recording a sufficient amount of noise required for training such a system is costly since noise transmission between outer and inner microphones varies individually. Previously proposed methods either do not consider noise, only consider noise at outer microphones or assume inner and outer microphone noise to be independent during training, and it is not yet clear whether individualized noise can benefit the training of and own voice reconstruction system. In this paper, we investigate several noise data augmentation techniques based on measured transfer functions to simulate multi-microphone noise. Using augmented noise, we train a multi-channel own voice reconstruction system. Experiments using real noise are carried out to investigate the generalization capability. Results show that incorporating augmented noise yields large benefits, in particular considering individualized noise augmentation leads to higher performance.

📄 PDF Abstract BibTeX arXiv:2312.08908

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Speech-dependent Data Augmentation for Own Voice Reconstruction with Hearable Microphones in Noisy Environments

2024-05-19 · Mattes Ohlenbusch, Christian Rollwage, Simon Doclo

Own voice pickup for hearables in noisy environments benefits from using both an outer and an in-ear microphone outside and inside the occluded ear. Due to environmental noise recorded at both microphones, and amplificat…

Data Augmentation

Improved in-car sound pick-up using multichannel Wiener filter

2025-06-11 · Juhi Khalid, Martin Bouchard

With advancements in automotive electronics and sensors, the sound pick-up using multiple microphones has become feasible for hands-free telephony and voice command in-car applications. However, challenges remain in effe…

Noise-Robust Hearing Aid Voice Control

2024-11-05 · Iván López-Espejo, Eros Roselló, Amin Edraki, Naomi Harte 외

Advancing the design of robust hearing aid (HA) voice control is crucial to increase the HA use rate among hard of hearing people as well as to improve HA users' experience. In this work, we contribute towards this goal …

Keyword Spotting

Toward noise-robust whisper keyword spotting on headphones with in-earcup microphone and curriculum learning

2025-02-01 · Qiaoyu Yang, Shuo Zhang, Chuan-Che Huang

The expanding feature set of modern headphones puts a challenge on the design of their control interface. Users may want to separately control each feature or quickly switch between modes that activate different features…

Keyword Spotting

Speech-dependent Modeling of Own Voice Transfer Characteristics for In-ear Microphones in Hearables

2023-09-15 · Mattes Ohlenbusch, Christian Rollwage, Simon Doclo

Many hearables contain an in-ear microphone, which may be used to capture the own voice of its user in noisy environments. Since the in-ear microphone mostly records body-conducted speech due to ear canal occlusion, it s…

Bandwidth ExtensionPhoneme Recognition