paper-with-me

홈 › Papers

CardioEmbed: Domain-Specialized Text Embeddings for Clinical Cardiology

2025-11-14 · Richard J. Young, Alice M. Matthews arxiv

Biomedical text embeddings have primarily been developed using research literature from PubMed, yet clinical cardiology practice relies heavily on procedural knowledge and specialized terminology found in comprehensive textbooks rather than research abstracts. This research practice gap limits the effectiveness of existing embedding models for clinical applications incardiology. This study trained CardioEmbed, a domain-specialized embedding model based on Qwen3-Embedding-8B, using contrastive learning on a curated corpus of seven comprehensive cardiology textbooks totaling approximately 150,000 sentences after deduplication. The model employs InfoNCE loss with in-batch negatives and achieves 99.60% retrieval accuracy on cardiac-specific semantic retrieval tasks, a +15.94 percentage point improvement over MedTE, the current state-of-the-art medical embedding model. On MTEB medical benchmarks, the model obtained BIOSSES 0.77 Spearman and SciFact 0.61 NDCG@10, indicating competitive performance on related biomedical domains. Domain-specialized training on comprehensive clinical textbooks yields near-perfect cardiology retrieval (99.60% Acc@1), improving over MedTE by +15.94 percentage points.

📄 PDF Abstract BibTeX arXiv:2511.10930

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningSemantic Retrieval

Similar Papers 제목 키워드 기반

Embedding Strategies for Specialized Domains: Application to Clinical Entity Recognition

2019-07-01 · ACL 2019 7 · Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, Pierre Zweigenbaum

Using pre-trained word embeddings in conjunction with Deep Learning models has become the {``}de facto{''} approach in Natural Language Processing (NLP). While this usually yields satisfactory results, off-the-shelf word…

Clinical Concept ExtractionWord Embeddings

QIME: Constructing Interpretable Medical Text Embeddings via Ontology-Grounded Questions

2026-03-02 · Yixuan Tang, Zhenghong Lin, Yandong Sun, Wynne Hsu 외 arxiv

While dense biomedical embeddings achieve strong performance, their black-box nature limits their utility in clinical decision-making. Recent question-based interpretable embeddings represent text as binary answers to na…

Semantic Similarity

Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition

2017-06-29 · Inigo Jauregi Unanue, Ehsan Zare Borzeshi, Massimo Piccardi

Background. Previous state-of-the-art systems on Drug Name Recognition (DNR) and Clinical Concept Extraction (CCE) have focused on a combination of text "feature engineering" and conventional machine learning algorithms …

BIG-bench Machine LearningClinical Concept ExtractionFeature Engineeringnamed-entity-recognition+3

CLISTER : A Corpus for Semantic Textual Similarity in French Clinical Narratives

2022-06-01 · LREC 2022 6 · Nicolas Hiebel, Olivier Ferret, Karën Fort, Aurélie Névéol

Modern Natural Language Processing relies on the availability of annotated corpora for training and evaluating models. Such resources are scarce, especially for specialized domains in languages other than English. In par…

Semantic SimilaritySemantic Textual SimilaritySentenceSentence Embeddings+3

Specialty-Specific Medical Language Model for Immune-Mediated Diseases

2026-04-12 · Veysel Kocaman, Gursev Pirge, Yigit Gul, Ace Vo 외 arxiv

Extracting detailed clinical information from free-text medical narratives remains a practical challenge for researchers and healthcare systems. Terminology for immune-mediated and infectious diseases is especially incon…