Cost-Quality Adaptive Active Learning for Chinese Clinical Named Entity Recognition
Clinical Named Entity Recognition (CNER) aims to automatically identity clinical terminologies in Electronic Health Records (EHRs), which is a fundamental and crucial step for clinical research. To train a high-performance model for CNER, it usually requires a large number of EHRs with high-quality labels. However, labeling EHRs, especially Chinese EHRs, is time-consuming and expensive. One effective solution to this is active learning, where a model asks labelers to annotate data which the model is uncertain of. Conventional active learning assumes a single labeler that always replies noiseless answers to queried labels. However, in real settings, multiple labelers provide diverse quality of annotation with varied costs and labelers with low overall annotation quality can still assign correct labels for some specific instances. In this paper, we propose a Cost-Quality Adaptive Active Learning (CQAAL) approach for CNER in Chinese EHRs, which maintains a balance between the annotation quality, labeling costs, and the informativeness of selected instances. Specifically, CQAAL selects cost-effective instance-labeler pairs to achieve better annotation quality with lower costs in an adaptive manner. Computational results on the CCKS-2017 Task 2 benchmark dataset demonstrate the superiority and effectiveness of the proposed CQAAL.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningInformativenessnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Task 2Similar Papers 제목 키워드 기반
Building a comprehensive syntactic and semantic corpus of Chinese clinical texts
Objective: To build a comprehensive corpus covering syntactic and semantic annotations of Chinese clinical texts with corresponding annotation guidelines and methods as well as to develop tools trained on the annotated c…
Active LearningPOSOn Learning Better Embeddings from Chinese Clinical Records: Study on Combining In-Domain and Out-Domain Data
High quality word embeddings are of great significance to advance applications of biomedical natural language processing. In recent years, a surge of interest on how to learn good embeddings and evaluate embedding qualit…
Disease PredictionInformation RetrievalLanguage ModelingLanguage Modelling+1NE-LP: Normalized Entropy and Loss Prediction based Sampling for Active Learning in Chinese Word Segmentation on EHRs
Electronic Health Records (EHRs) in hospital information systems contain patients' diagnosis and treatments, so EHRs are essential to clinical data mining. Of all the tasks in the mining process, Chinese Word Segmentatio…
Active LearningChinese Word SegmentationHuman-Computer Interactive Chinese Word Segmentation: An Adaptive Dirichlet Process Mixture Model Approach
Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration
Medical image segmentation is one of the fundamental problems for artificial intelligence-based clinical decision systems. Current automatic medical image segmentation methods are often failed to meet clinical requiremen…
Image SegmentationInteractive SegmentationMedical Image SegmentationMulti-agent Reinforcement Learning+2