paper-with-me

Papers

Multi-objective Non-intrusive Hearing-aid Speech Assessment Model

2023-11-15 · Hsin-Tien Chiang, Szu-Wei Fu, Hsin-Min Wang, Yu Tsao, John H. L. Hansen

Without the need for a clean reference, non-intrusive speech assessment methods have caught great attention for objective evaluations. While deep learning models have been used to develop non-intrusive speech assessment methods with promising results, there is limited research on hearing-impaired subjects. This study proposes a multi-objective non-intrusive hearing-aid speech assessment model, called HASA-Net Large, which predicts speech quality and intelligibility scores based on input speech signals and specified hearing-loss patterns. Our experiments showed the utilization of pre-trained SSL models leads to a significant boost in speech quality and intelligibility predictions compared to using spectrograms as input. Additionally, we examined three distinct fine-tuning approaches that resulted in further performance improvements. Furthermore, we demonstrated that incorporating SSL models resulted in greater transferability to OOD dataset. Finally, this study introduces HASA-Net Large, which is a non-invasive approach for evaluating speech quality and intelligibility. HASA-Net Large utilizes raw waveforms and hearing-loss patterns to accurately predict speech quality and intelligibility levels for individuals with normal and impaired hearing and demonstrates superior prediction performance and transferability.

📄 PDF Abstract BibTeX arXiv:2311.08878

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

HASA-net: A non-intrusive hearing-aid speech assessment network

2021-11-10 · Hsin-Tien Chiang, Yi-Chiao Wu, Cheng Yu, Tomoki Toda 외

Without the need of a clean reference, non-intrusive speech assessment methods have caught great attention for objective evaluations. Recently, deep neural network (DNN) models have been applied to build non-intrusive sp…

Non-Intrusive Speech Intelligibility Prediction for Hearing Aids using Whisper and Metadata

2023-09-18 · Ryandhimas E. Zezario, Fei Chen, Chiou-Shann Fuh, Hsin-Min Wang 외

Automated speech intelligibility assessment is pivotal for hearing aid (HA) development. In this paper, we present three novel methods to improve intelligibility prediction accuracy and introduce MBI-Net+, an enhanced ve…

Multi-Task LearningPredictionSelf-Supervised Learning

Non Intrusive Intelligibility Predictor for Hearing Impaired Individuals using Self Supervised Speech Representations

2023-07-25 · George Close, Thomas Hain, Stefan Goetze

Self-supervised speech representations (SSSRs) have been successfully applied to a number of speech-processing tasks, e.g. as feature extractor for speech quality (SQ) prediction, which is, in turn, relevant for assessme…

PredictionSpeech Enhancement

Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listeners

2025-09-21 · Boxuan Cao, Linkai Li, Hanlin Yu, Changgeng Mo 외 arxiv

Speech intelligibility evaluation for hearing-impaired (HI) listeners is essential for assessing hearing aid performance, traditionally relying on listening tests or intrusive methods like HASPI. However, these methods r…

A Study on Incorporating Whisper for Robust Speech Assessment

2023-09-22 · Ryandhimas E. Zezario, Yu-Wen Chen, Szu-Wei Fu, Yu Tsao 외

This research introduces an enhanced version of the multi-objective speech assessment model--MOSA-Net+, by leveraging the acoustic features from Whisper, a large-scaled weakly supervised model. We first investigate the e…

Self-Supervised Learning