Sectioning of Biomedical Abstracts: A Sequence of Sequence Classification Task
Rapid growth of the biomedical literature has led to many advances in the biomedical text mining field. Among the vast amount of information, biomedical article abstracts are the easily accessible sources. However, the number of the structured abstracts, describing the rhetorical sections with one of Background, Objective, Method, Result and Conclusion categories is still not considerable. Exploration of valuable information in the biomedical abstracts can be expedited with the improvements in the sequential sentence classification task. Deep learning based models has great performance/potential in achieving significant results in this task. However, they can often be overly complex and overfit to specific data. In this project, we study a state-of-the-art deep learning model, which we called SSN-4 model here. We investigate different components of the SSN-4 model to study the trade-off between the performance and complexity. We explore how well this model generalizes to a new data set beyond Randomized Controlled Trials (RCT) dataset. We address the question that whether word embeddings can be adjusted to the task to improve the performance. Furthermore, we develop a second model that addresses the confusion pairs in the first model. Results show that SSN-4 model does not appear to generalize well beyond RCT dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence ClassificationWord EmbeddingsSimilar Papers 제목 키워드 기반
Sequential Span Classification with Neural Semi-Markov CRFs for Biomedical Abstracts
Dividing biomedical abstracts into several segments with rhetorical roles is essential for supporting researchers{'} information access in the biomedical domain. Conventional methods have regarded the task as a sequence …
SentenceSentence ClassificationStructured Multi-Label Biomedical Text Tagging via Attentive Neural Tree Decoding
We propose a model for tagging unstructured texts with an arbitrary number of terms drawn from a tree-structured vocabulary (i.e., an ontology). We treat this as a special case of sequence-to-sequence learning in which t…
DecoderNEREL-BIO: A Dataset of Biomedical Abstracts Annotated with Nested Named Entities
This paper describes NEREL-BIO -- an annotation scheme and corpus of PubMed abstracts in Russian and smaller number of abstracts in English. NEREL-BIO extends the general domain dataset NEREL by introducing domain-specif…
Machine Reading ComprehensionReading ComprehensionAggregating and Predicting Sequence Labels from Crowd Annotations
Despite sequences being core to NLP, scant work has considered how to handle noisy sequence labels from multiple annotators for the same text. Given such annotations, we consider two complementary tasks: (1) aggregating …
Articlesnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1A PubMed-Scale Dataset of Structured Biomedical Abstracts
Structured abstracts are important for biomedical literature processing, by facilitating information retrieval, text mining, and knowledge synthesis. However, a vast portion of abstracts indexed in PubMed remain unstruct…
Information ExtractionInformation Retrieval