paper-with-me

Papers

AI Assisted Annotator using Reinforcement Learning

2019-10-02 · V. Ratna Saripalli, Gopal Avinash, Dibyajyoti Pati, Michael Potter, Charles W. Anderson

Healthcare data suffers from both noise and lack of ground truth. The cost of data increases as it is cleaned and annotated in healthcare. Unlike other data sets, medical data annotation, which is critical to accurate ground truth, requires medical domain expertise for a better patient outcome. In this work, we report on the use of reinforcement learning to mimic the decision making process of annotators for medical events, to automate annotation and labelling. The reinforcement agent learns to annotate alarm data based on annotations done by an expert. Our method shows promising results on medical alarm data sets. We trained DQN and A2C agents using the data from monitoring devices annotated by an expert. Initial results from these RL agents learning the expert annotation behavior are promising. The A2C agent performs better in terms of learning the sparse events in a given state, thereby choosing more right actions compared to DQN agent. To the best of our knowledge, this is the first reinforcement learning application for the automation of medical events annotation, which has far-reaching practical use.

📄 PDF Abstract BibTeX arXiv:1910.02052

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…
A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Similar Papers 제목 키워드 기반

Computer Assisted Annotation of Tension Development in TED Talks through Crowdsourcing

2019-11-01 · WS 2019 11 · Seungwon Yoon, Wonsuk Yang, Jong Park

We propose a method of machine-assisted annotation for the identification of tension development, annotating whether the tension is increasing, decreasing, or staying unchanged. We use a neural network based prediction m…

First Results in a Study Evaluating Pre-annotation and Correction Propagation for Machine-Assisted Syriac Morphological Analysis

2012-05-01 · LREC 2012 5 · Paul Felt, Eric Ringger, Kevin Seppi, Kristian Heal 외

Manual annotation of large textual corpora can be cost-prohibitive, especially for rare and under-resourced languages. One potential solution is pre-annotation: asking human annotators to correct sentences that have alre…

Morphological AnalysisSentence

Annotating Named Entities in Consumer Health Questions

2016-05-01 · LREC 2016 5 · Halil Kilicoglu, Asma Ben Abacha, Yassine Mrabet, Kirk Roberts 외

We describe a corpus of consumer health questions annotated with named entities. The corpus consists of 1548 de-identified questions about diseases and drugs, written in English. We defined 15 broad categories of biomedi…

Model-Assisted Labeling via Explainability for Visual Inspection of Civil Infrastructures

2022-09-22 · Klara Janouskova, Mattia Rigotti, Ioana Giurgiu, Cristiano Malossi

Labeling images for visual segmentation is a time-consuming task which can be costly, particularly in application domains where labels have to be provided by specialized expert annotators, such as civil engineering. In t…

Segmentation

Is Semi-Automatic Transcription Useful in Corpus Creation? Preliminary Considerations on the KIParla Corpus

2026-03-17 · Martina Simonotti, Ludovica Pannitto, Eleonora Zucchini, Silvia Ballarè 외 arxiv

This paper analyses the implementation of Automatic Speech Recognition (ASR) into the transcription workflow of the KIParla corpus, a resource of spoken Italian. Through a two-phase experiment, 11 expert and novice trans…

Speech Recognition