An Adversarial Multi-Task Learning Method for Chinese Text Correction with Semantic Detection
Text correction, especially the semantic correction of more widely used scenes, is strongly required to improve, for the fluency and writing efficiency of the text. An adversarial multi-task learning method is proposed to enhance the modeling and detection ability of character polysemy in Chinese sentence context. Wherein, two models, the masked language model and scoring language model, are introduced as a pair of not only coupled but also adversarial learning tasks. Moreover, the Monte Carlo tree search strategy and a policy network are introduced to accomplish the efficient Chinese text correction task with semantic detection. The experiments are executed on three datasets and five comparable methods, and the experimental results show that our method can obtain good performance in Chinese text correction task for better semantic rationality.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingMulti-Task LearningSentenceSimilar Papers 제목 키워드 기반
Learning from Mistakes: Self-correct Adversarial Training for Chinese Unnatural Text Correction
Unnatural text correction aims to automatically detect and correct spelling errors or adversarial perturbation errors in sentences. Existing methods typically rely on fine-tuning or adversarial training to correct errors…
Adversarial multi-task learning to solve holistic semantic polishing problem of Chinese text
For the core obstacles faced by Chinese proofreading, we think that the effective holistic semantic feature representation of a sentence and its characteristics is a key. Here, we propose a novel adversarial multi-task l…
Multi-Task LearningSentenceOn the (In)Effectiveness of Large Language Models for Chinese Text Correction
Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to …
Grammatical Error CorrectionCLFEC: A New Task for Unified Linguistic and Factual Error Correction in paragraph-level Chinese Professional Writing
Chinese text correction has traditionally focused on spelling and grammar, while factual error correction is usually treated separately. However, in paragraph-level Chinese professional writing, linguistic (word/grammar/…
Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models
A sequence-to-sequence learning with neural networks has empirically proven to be an effective framework for Chinese Spelling Correction (CSC), which takes a sentence with some spelling errors as input and outputs the co…
SentenceSpelling CorrectionVocal Bursts Valence Prediction