paper-with-me

Papers

Improving Grapheme-to-Phoneme Conversion through In-Context Knowledge Retrieval with Large Language Models

2024-11-12 · Dongrui Han, Mingyu Cui, Jiawen Kang, Xixin Wu, Xunying Liu, Helen Meng

Grapheme-to-phoneme (G2P) conversion is a crucial step in Text-to-Speech (TTS) systems, responsible for mapping grapheme to corresponding phonetic representations. However, it faces ambiguities problems where the same grapheme can represent multiple phonemes depending on contexts, posing a challenge for G2P conversion. Inspired by the remarkable success of Large Language Models (LLMs) in handling context-aware scenarios, contextual G2P conversion systems with LLMs' in-context knowledge retrieval (ICKR) capabilities are proposed to promote disambiguation capability. The efficacy of incorporating ICKR into G2P conversion systems is demonstrated thoroughly on the Librig2p dataset. In particular, the best contextual G2P conversion system using ICKR outperforms the baseline with weighted average phoneme error rate (PER) reductions of 2.0% absolute (28.9% relative). Using GPT-4 in the ICKR system can increase of 3.5% absolute (3.8% relative) on the Librig2p dataset.

📄 PDF Abstract BibTeX arXiv:2411.07563

Code (0)

등록된 구현이 없습니다.

Tasks

Grapheme-to-Phoneme ConversionRetrievaltext-to-speechText to Speech

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

LLM-Powered Grapheme-to-Phoneme Conversion: Benchmark and Case Study

2024-09-13 · Mahta Fetrat Qharabagh, Zahra Dehghanian, Hamid R. Rabiee

Grapheme-to-phoneme (G2P) conversion is critical in speech processing, particularly for applications like speech synthesis. G2P systems must possess linguistic understanding and contextual awareness of languages with pol…

BenchmarkingGrapheme-to-Phoneme ConversionSentenceSpeech Synthesis

The SIGMORPHON 2020 Shared Task on Multilingual Grapheme-to-Phoneme Conversion

2020-07-01 · WS 2020 7 · Kyle Gorman, Lucas F.E. Ashby, Aaron Goyzueta, Arya McCarthy 외

We describe the design and findings of the SIGMORPHON 2020 shared task on multilingual grapheme-to-phoneme conversion. Participants were asked to submit systems which take in a sequence of graphemes in a given language a…

Grapheme-to-Phoneme Conversion

Results of the Second SIGMORPHON Shared Task on Multilingual Grapheme-to-Phoneme Conversion

2021-08-01 · ACL (SIGMORPHON) 2021 8 · Lucas F.E. Ashby, Travis M. Bartley, Simon Clematide, Luca Del Signore 외

Grapheme-to-phoneme conversion is an important component in many speech technologies, but until recently there were no multilingual benchmarks for this task. The second iteration of the SIGMORPHON shared task on multilin…

Grapheme-to-Phoneme Conversion

Frustratingly Easy Multilingual Grapheme-to-Phoneme Conversion

2020-07-01 · WS 2020 7 · Nikhil Prabhu, Katharina Kann

In this paper, we describe two CU-Boulder submissions to the SIGMORPHON 2020 Task 1 on multilingual grapheme-to-phoneme conversion (G2P). Inspired by the high performance of a standard transformer model (Vaswani et al., …

Grapheme-to-Phoneme Conversion

Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State Transducers

2022-09-05 · IEEE Access 2022 9 · Kavya Manohar, A R jayan, Rajeev Rajan

In this article we present the design and the development of a knowledge based computational linguistic tool, Mlphon for Malayalam language. Mlphon computationally models linguistic rules using finite state transducers a…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DiversityGrapheme-to-Phoneme Conversion+10