CardioEmbed: Domain-Specialized Text Embeddings for Clinical Cardiology
Biomedical text embeddings have primarily been developed using research literature from PubMed, yet clinical cardiology practice relies heavily on procedural knowledge and specialized terminology found in comprehensive textbooks rather than research abstracts. This research practice gap limits the effectiveness of existing embedding models for clinical applications incardiology. This study trained CardioEmbed, a domain-specialized embedding model based on Qwen3-Embedding-8B, using contrastive learning on a curated corpus of seven comprehensive cardiology textbooks totaling approximately 150,000 sentences after deduplication. The model employs InfoNCE loss with in-batch negatives and achieves 99.60% retrieval accuracy on cardiac-specific semantic retrieval tasks, a +15.94 percentage point improvement over MedTE, the current state-of-the-art medical embedding model. On MTEB medical benchmarks, the model obtained BIOSSES 0.77 Spearman and SciFact 0.61 NDCG@10, indicating competitive performance on related biomedical domains. Domain-specialized training on comprehensive clinical textbooks yields near-perfect cardiology retrieval (99.60% Acc@1), improving over MedTE by +15.94 percentage points.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningSemantic RetrievalSimilar Papers 제목 키워드 기반
Embedding Strategies for Specialized Domains: Application to Clinical Entity Recognition
Using pre-trained word embeddings in conjunction with Deep Learning models has become the {``}de facto{''} approach in Natural Language Processing (NLP). While this usually yields satisfactory results, off-the-shelf word…
Clinical Concept ExtractionWord EmbeddingsQIME: Constructing Interpretable Medical Text Embeddings via Ontology-Grounded Questions
While dense biomedical embeddings achieve strong performance, their black-box nature limits their utility in clinical decision-making. Recent question-based interpretable embeddings represent text as binary answers to na…
Semantic SimilarityRecurrent neural networks with specialized word embeddings for health-domain named-entity recognition
Background. Previous state-of-the-art systems on Drug Name Recognition (DNR) and Clinical Concept Extraction (CCE) have focused on a combination of text "feature engineering" and conventional machine learning algorithms …
BIG-bench Machine LearningClinical Concept ExtractionFeature Engineeringnamed-entity-recognition+3CLISTER : A Corpus for Semantic Textual Similarity in French Clinical Narratives
Modern Natural Language Processing relies on the availability of annotated corpora for training and evaluating models. Such resources are scarce, especially for specialized domains in languages other than English. In par…
Semantic SimilaritySemantic Textual SimilaritySentenceSentence Embeddings+3Specialty-Specific Medical Language Model for Immune-Mediated Diseases
Extracting detailed clinical information from free-text medical narratives remains a practical challenge for researchers and healthcare systems. Terminology for immune-mediated and infectious diseases is especially incon…