paper-with-me

Papers

Alternate Intermediate Conditioning with Syllable-level and Character-level Targets for Japanese ASR

2022-04-01 · Yusuke Fujita, Tatsuya Komatsu, Yusuke Kida

End-to-end automatic speech recognition directly maps input speech to characters. However, the mapping can be problematic when several different pronunciations should be mapped into one character or when one pronunciation is shared among many different characters. Japanese ASR suffers the most from such many-to-one and one-to-many mapping problems due to Japanese kanji characters. To alleviate the problems, we introduce explicit interaction between characters and syllables using Self-conditioned connectionist temporal classification (CTC), in which the upper layers are ``self-conditioned'' on the intermediate predictions from the lower layers. The proposed method utilizes character-level and syllable-level intermediate predictions as conditioning features to deal with mutual dependency between characters and syllables. Experimental results on Corpus of Spontaneous Japanese show that the proposed method outperformed the conventional multi-task and Self-conditioned CTC methods.

📄 PDF Abstract BibTeX arXiv:2204.00175

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Multi-Task Learningspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition

2022-05-24 · Yuting Yang, Binbin Du, Yuke Li

The choice of modeling units is crucial for automatic speech recognition (ASR) tasks. In mandarin scenarios, the Chinese characters represent meaning but are not directly related to the pronunciation. Thus only consideri…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderLanguage Modelling+2

Syllable-level lyrics generation from melody exploiting character-level language model

2023-10-02 · Zhe Zhang, Karol Lasocki, Yi Yu, Atsuhiro Takasu

The generation of lyrics tightly connected to accompanying melodies involves establishing a mapping between musical notes and syllables of lyrics. This process requires a deep understanding of music constraints and seman…

Language ModelingLanguage ModellingSentence

Syllable-aware Neural Language Models: A Failure to Beat Character-aware Ones

2017-07-20 · EMNLP 2017 9 · Zhenisbek Assylbekov, Rustem Takhanov, Bagdat Myrzakhmetov, Jonathan N. Washington

Syllabification does not seem to improve word-level RNN language modeling quality when compared to character-based segmentation. However, our best syllable-aware language model, achieving performance comparable to the co…

Language ModelingLanguage ModellingSegmentation

Orthographic Syllable as basic unit for SMT between Related Languages

2016-10-03 · EMNLP 2016 11 · Anoop Kunchukuttan, Pushpak Bhattacharyya

We explore the use of the orthographic syllable, a variable-length consonant-vowel sequence, as a basic unit of translation between related languages which use abugida or alphabetic scripts. We show that orthographic syl…

Translation

Learning to Pronounce Chinese Without a Pronunciation Dictionary

2020-10-09 · EMNLP 2020 11 · Christopher Chu, Scot Fang, Kevin Knight

We demonstrate a program that learns to pronounce Chinese text in Mandarin, without a pronunciation dictionary. From non-parallel streams of Chinese characters and Chinese pinyin syllables, it establishes a many-to-many …