paper-with-me

Papers

Recovering implicit pitch contours from formants in whispered speech

2023-07-06 · Pablo Pérez Zarazaga, Zofia Malisz

Whispered speech is characterised by a noise-like excitation that results in the lack of fundamental frequency. Considering that prosodic phenomena such as intonation are perceived through f0 variation, the perception of whispered prosody is relatively difficult. At the same time, studies have shown that speakers do attempt to produce intonation when whispering and that prosodic variability is being transmitted, suggesting that intonation "survives" in whispered formant structure. In this paper, we aim to estimate the way in which formant contours correlate with an "implicit" pitch contour in whisper, using a machine learning model. We propose a two-step method: using a parallel corpus, we first transform the whispered formants into their phonated equivalents using a denoising autoencoder. We then analyse the formant contours to predict phonated pitch contour variation. We observe that our method is effective in establishing a relationship between whispered and phonated formants and in uncovering implicit pitch contours in whisper.

📄 PDF Abstract BibTeX arXiv:2307.03168

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising

Similar Papers 제목 키워드 기반

Whispered-to-voiced Alaryngeal Speech Conversion with Generative Adversarial Networks

2018-08-31 · Santiago Pascual, Antonio Bonafonte, Joan Serrà, Jose A. Gonzalez

Most methods of voice restoration for patients suffering from aphonia either produce whispered or monotone speech. Apart from intelligibility, this type of speech lacks expressiveness and naturalness due to the absence o…

Speech EnhancementSpeech Recognition

Quartered Spectral Envelope and 1D-CNN-based Classification of Normally Phonated and Whispered Speech

2024-08-25 · S. Johanan Joysingh, P. Vijayalakshmi, T. Nagarajan

Whisper, as a form of speech, is not sufficiently addressed by mainstream speech applications. This is due to the fact that systems built for normal speech do not work as expected for whispered speech. A first step to bu…

Quantifying and Correlating Rhythm Formants in Speech

2019-09-03 · Dafydd Gibbon, Peng Li

The objective of the present study is exploratory: to introduce and apply a new theory of speech rhythm zones or rhythm formants (R-formants). R-formants are zones of high magnitude frequencies in the low frequency (LF) …

Rhythm

FretNet: Continuous-Valued Pitch Contour Streaming for Polyphonic Guitar Tablature Transcription

2022-12-06 · Frank Cwitkowitz, Toni Hirvonen, Anssi Klapuri

In recent years, the task of Automatic Music Transcription (AMT), whereby various attributes of music notes are estimated from audio, has received increasing attention. At the same time, the related task of Multi-Pitch E…

Music TranscriptionQuantization

Refining a Deep Learning-based Formant Tracker using Linear Prediction Methods

2023-08-17 · Paavo Alku, Sudarsana Reddy Kadiri, Dhananjaya Gowda

In this study, formant tracking is investigated by refining the formants tracked by an existing data-driven tracker, DeepFormants, using the formants estimated in a model-driven manner by linear prediction (LP)-based met…