Enhancing Automatic PT Tagging for MEDLINE Citations Using Transformer-Based Models

2025-06-03 · Victor H. Cid, James Mork

We investigated the feasibility of predicting Medical Subject Headings (MeSH) Publication Types (PTs) from MEDLINE citation metadata using pre-trained Transformer-based models BERT and DistilBERT. This study addresses limitations in the current automated indexing process, which relies on legacy NLP algorithms. We evaluated monolithic multi-label classifiers and binary classifier ensembles to enhance the retrieval of biomedical literature. Results demonstrate the potential of Transformer models to significantly improve PT tagging accuracy, paving the way for scalable, efficient biomedical indexing.

📄 PDF Abstract BibTeX arXiv:2506.03321

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

WordPiece 설명 없음

Weight Decay 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Adam 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

A Hybrid Citation Retrieval Algorithm for Evidence-based Clinical Knowledge Summarization: Combining Concept Extraction, Vector Similarity and Query Expansion for High Precision

2016-09-06 · Kalpana Raja, Andrew J Sauer, Ravi P Garg, Melanie R Klerer 외

Novel information retrieval methods to identify citations relevant to a clinical topic can overcome the knowledge gap existing between the primary literature (MEDLINE) and online clinical knowledge resources such as UpTo…

Clinical Knowledge Information Retrieval Retrieval

Particle Multi-Axis Transformer for Jet Tagging

2024-06-09 · Muhammad Usman, M Husnain Shahid, Maheen Ejaz, Ummay Hani 외

Jet tagging is an essential categorization problem in high energy physics. In recent times, Deep Learning has not only risen to the challenge of jet tagging but also significantly improved its performance. In this articl…

Jet Tagging

Clinical Concept Extraction: a Methodology Review

2019-10-24 · Sunyang Fu, David Chen, Huan He, Sijia Liu 외

Background Concept extraction, a subdomain of natural language processing (NLP) with a focus on extracting concepts of interest, has been adopted to computationally extract clinical information from text for a wide range…

Articles Clinical Concept Extraction Decision Making

POMELO: Medline corpus with manually annotated food-drug interactions

2017-09-01 · RANLP 2017 9 · Thierry Hamon, Vincent Tabanou, Fleur Mougin, Natalia Grabar 외

When patients take more than one medication, they may be at risk of drug interactions, which means that a given drug can cause unexpected effects when taken in combination with other drugs. Similar effects may occur when…

READ-BioMed@SocialDisNER: Adaptation of an Annotation System to Spanish Tweets

2022-10-01 · SMM4H (COLING) 2022 10 · Antonio Jimeno Yepes, Karin Verspoor

We describe the work of the READ-BioMed team for the preparation of a submission to the SocialDisNER Disease Named Entity Recognition (NER) Task (Task 10) in 2022. We had developed a system for named entity recognition f…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)NER