Adversarial multi-task learning to solve holistic semantic polishing problem of Chinese text
For the core obstacles faced by Chinese proofreading, we think that the effective holistic semantic feature representation of a sentence and its characteristics is a key. Here, we propose a novel adversarial multi-task learning framework to realize above point. Wherein, sentence scoring and word prediction tasks are considered as not only a group of multi-tasks, but also a couple of generative adversarial relationship. Moreover, a policy network is introduced to achieve text polishing based on above adversarial multi-task model and Monte Carlo search training strategy. The ablation experiment results on Xuexi and CLUE corpus show that, for text scoring and prediction tasks, adversarial multi-task learning achieves a 10-20% improvement in accuracy and F1-score compared to the baseline. And, in text correction task, our method is significantly better than the baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task LearningSentenceSimilar Papers 제목 키워드 기반
PanDepth: Joint Panoptic Segmentation and Depth Completion
Understanding 3D environments semantically is pivotal in autonomous driving applications where multiple computer vision tasks are involved. Multi-task models provide different types of outputs for a given scene, yielding…
Autonomous DrivingDepth CompletionInstance SegmentationPanoptic Segmentation+2Adversarial Semantic Decoupling for Recognizing Open-Vocabulary Slots
Open-vocabulary slots, such as file name, album name, or schedule title, significantly degrade the performance of neural-based slot filling models since these slots can take on values from a virtually unlimited set and h…
Sentenceslot-fillingSlot FillingStructured Knowledge Distillation for Semantic Segmentation
In this paper, we investigate the issue of knowledge distillation for training compact semantic segmentation networks by making use of cumbersome networks. We start from the straightforward scheme, pixel-wise distillatio…
General Classificationimage-classificationImage ClassificationKnowledge Distillation+4KE-GAN: Knowledge Embedded Generative Adversarial Networks for Semi-Supervised Scene Parsing
In recent years, scene parsing has captured increasing attention in computer vision. Previous works have demonstrated promising performance in this task. However, they mainly utilize holistic features, whilst neglecting …
Scene ParsingStructured Knowledge Distillation for Dense Prediction
In this work, we consider transferring the structure information from large networks to compact ones for dense prediction tasks in computer vision. Previous knowledge distillation strategies used for dense prediction tas…
Depth EstimationGeneral Classificationimage-classificationImage Classification+7