PHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling Check
Chinese Spelling Check (CSC) is a challenging task due to the complex characteristics of Chinese characters. Statistics reveal that most Chinese spelling errors belong to phonological or visual errors. However, previous methods rarely utilize phonological and morphological knowledge of Chinese characters or heavily rely on external resources to model their similarities. To address the above issues, we propose a novel end-to-end trainable model called PHMOSpell, which promotes the performance of CSC with multi-modal information. Specifically, we derive pinyin and glyph representations for Chinese characters from audio and visual modalities respectively, which are integrated into a pre-trained language model by a well-designed adaptive gating mechanism. To verify its effectiveness, we conduct comprehensive experiments and ablation tests. Experimental results on three shared benchmarks demonstrate that our model consistently outperforms previous state-of-the-art models.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Spell CheckingLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
Phun-Bench: Evaluating LLMs on Phonological Understanding in Chinese
Language is a vehicle for thought, intricately tied to sounds, symbols, and meaning. However, most large language model (LLM) research focuses on meaning (semantics) and symbols (spelling) while largely overlooking sound…
SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check
Chinese Spelling Check (CSC) is a task to detect and correct spelling errors in Chinese natural language. Existing methods have made attempts to incorporate the similarity knowledge between Chinese characters. However, t…
Finite-state morphology for Kwak'wala: A phonological approach
This paper presents the phonological layer of a Kwak{'}wala finite-state morphological transducer, using the phonological hypotheses of Lincoln and Rath (1986) and the lenient composition operation of Karttunen (1998) to…
Phonological Features for Morphological Inflection
Modeling morphological inflection is an important task in Natural Language Processing. In contrast to earlier work that has largely used orthographic representations, we experiment with this task in a phonetic character …
Machine TranslationMorphological AnalysisMorphological InflectionTransfer LearningMorphological Inflection with Phonological Features
Recent years have brought great advances into solving morphological tasks, mostly due to powerful neural models applied to various tasks as (re)inflection and analysis. Yet, such morphological tasks cannot be considered …
Morphological Inflection