Applications of BERT Based Sequence Tagging Models on Chinese Medical Text Attributes Extraction

2020-08-22 · Gang Zhao, Teng Zhang, Chenxiao Wang, Ping Lv, Ji Wu

We convert the Chinese medical text attributes extraction task into a sequence tagging or machine reading comprehension task. Based on BERT pre-trained models, we have not only tried the widely used LSTM-CRF sequence tagging model, but also other sequence models, such as CNN, UCNN, WaveNet, SelfAttention, etc, which reaches similar performance as LSTM+CRF. This sheds a light on the traditional sequence tagging models. Since the aspect of emphasis for different sequence tagging models varies substantially, ensembling these models adds diversity to the final system. By doing so, our system achieves good performance on the task of Chinese medical text attributes extraction (subtask 2 of CCKS 2019 task 1).

📄 PDF Abstract BibTeX arXiv:2008.09740

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityMachine Reading Comprehension Reading Comprehension

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dilated Causal Convolution A Dilated Causal Convolution is a causal convolution where the filter is applied over an area larger than its length by…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Weight Decay 설명 없음

Adam 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

WordPiece 설명 없음

Mixture of Logistic Distributions 설명 없음

BERT Enhanced Neural Machine Translation and Sequence Tagging Model for Chinese Grammatical Error Diagnosis

2020-12-01 · AACL (NLP-TEA) 2020 12 · Deng Liang, Chen Zheng, Lei Guo, Xin Cui 외

This paper presents the UNIPUS-Flaubert team’s hybrid system for the NLPTEA 2020 shared task of Chinese Grammatical Error Diagnosis (CGED). As a challenging NLP task, CGED has attracted increasing attention recently and …

Grammatical Error Correction Machine Translation NMT Translation

Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter

2021-05-15 · ACL 2021 5 · Wei Liu, Xiyan Fu, Yue Zhang, Wenming Xiao

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a sha…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)Part-Of-Speech Tagging

Ancient Chinese Word Segmentation and Part-of-Speech Tagging Using Data Augmentation

2022-06-01 · LT4HALA (LREC) 2022 6 · Yanzhi Tian, Yuhang Guo

We attended the EvaHan2022 ancient Chinese word segmentation and Part-of-Speech (POS) tagging evaluation. We regard the Chinese word segmentation and POS tagging as sequence tagging tasks. Our system is based on a BERT-B…

Chinese Word Segmentation Data Augmentation Part-Of-Speech Tagging POS+2

BERT 4EVER@EvaHan 2022: Ancient Chinese Word Segmentation and Part-of-Speech Tagging Based on Adversarial Learning and Continual Pre-training

2022-06-01 · LT4HALA (LREC) 2022 6 · Hailin Zhang, Ziyu Yang, Yingwen Fu, Ruoyao Ding

With the development of artificial intelligence (AI) and digital humanities, ancient Chinese resources and language technology have also developed and grown, which have become an increasingly important part to the study …

Chinese Word Segmentation Cultural Vocal Bursts Intensity Prediction Ensemble Learning Part-Of-Speech Tagging+3

TransCouplet:Transformer based Chinese Couplet Generation

2021-12-03 · Kuan-Yu Chiang, Shihao Lin, Joe Chen, Qian Yin 외

Chinese couplet is a special form of poetry composed of complex syntax with ancient Chinese language. Due to the complexity of semantic and grammatical rules, creation of a suitable couplet is a formidable challenge. Thi…

Part-Of-Speech Tagging