Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies
In recent years, Internet users are reporting Adverse Drug Events (ADE) on social media, blogs and health forums. Because of the large volume of reports, pharmacovigilance is seeking to resort to NLP to monitor these outlets. We propose for the first time the use of the SpanBERT architecture for the task of ADE extraction: this new version of the popular BERT transformer showed improved capabilities with multi-token text spans. We validate our hypothesis with experiments on two datasets (SMM4H and CADEC) with different text typologies (tweets and blog posts), finding that SpanBERT combined with a CRF outperforms all the competitors on both of them.
Code (1)
Tasks
Event ExtractionPharmacovigilanceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection
Pretrained transformer-based models, such as BERT and its variants, have become a common choice to obtain state-of-the-art performances in NLP tasks. In the identification of Adverse Drug Events (ADE) from social media t…
Event DetectionAn Attentive Sequence Model for Adverse Drug Event Extraction from Biomedical Text
Adverse reaction caused by drugs is a potentially dangerous problem which may lead to mortality and morbidity in patients. Adverse Drug Event (ADE) extraction is a significant problem in biomedical research. We model ADE…
Event ExtractionGeneral ClassificationMachine Reading ComprehensionQuestion Answering+1Extracting Adverse Drug Events from Clinical Notes
Adverse drug events (ADEs) are unexpected incidents caused by the administration of a drug or medication. To identify and extract these events, we require information about not just the drug itself but attributes describ…
Language ModelingLanguage ModellingRelationRelation ExtractionMultiADE: A Multi-domain Benchmark for Adverse Drug Event Extraction
Active adverse event surveillance monitors Adverse Drug Events (ADE) from different data sources, such as electronic health records, medical literature, social media and search engine logs. Over the years, many datasets …
Domain AdaptationEvent ExtractionTransfer LearningBioDEX: Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilance
Timely and accurate extraction of Adverse Drug Events (ADE) from biomedical literature is paramount for public safety, but involves slow and costly manual labor. We set out to improve drug safety monitoring (pharmacovigi…
Event ExtractionPharmacovigilance