paper-with-me

홈 › Papers

Self-supervised Normality Learning and Divergence Vector-guided Model Merging for Zero-shot Congenital Heart Disease Detection in Fetal Ultrasound Videos

2025-03-10 · Pramit Saha, Divyanshu Mishra, Netzahualcoyotl Hernandez-Cruz, Olga Patey, Aris Papageorghiou, Yuki M. Asano, J. Alison Noble

Congenital Heart Disease (CHD) is one of the leading causes of fetal mortality, yet the scarcity of labeled CHD data and strict privacy regulations surrounding fetal ultrasound (US) imaging present significant challenges for the development of deep learning-based models for CHD detection. Centralised collection of large real-world datasets for rare conditions, such as CHD, from large populations requires significant co-ordination and resource. In addition, data governance rules increasingly prevent data sharing between sites. To address these challenges, we introduce, for the first time, a novel privacy-preserving, zero-shot CHD detection framework that formulates CHD detection as a normality modeling problem integrated with model merging. In our framework dubbed Sparse Tube Ultrasound Distillation (STUD), each hospital site first trains a sparse video tube-based self-supervised video anomaly detection (VAD) model on normal fetal heart US clips with self-distillation loss. This enables site-specific models to independently learn the distribution of healthy cases. To aggregate knowledge across the decentralized models while maintaining privacy, we propose a Divergence Vector-Guided Model Merging approach, DivMerge, that combines site-specific models into a single VAD model without data exchange. Our approach preserves domain-agnostic rich spatio-temporal representations, ensuring generalization to unseen CHD cases. We evaluated our approach on real-world fetal US data collected from 5 hospital sites. Our merged model outperformed site-specific models by 23.77% and 30.13% in accuracy and F1-score respectively on external test sets.

📄 PDF Abstract BibTeX arXiv:2503.07799

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionPrivacy PreservingVideo Anomaly Detection

Similar Papers 제목 키워드 기반

You've Got Two Teachers: Co-evolutionary Image and Report Distillation for Semi-supervised Anatomical Abnormality Detection in Chest X-ray

2023-07-18 · Jinghan Sun, Dong Wei, Zhe Xu, Donghuan Lu 외

Chest X-ray (CXR) anatomical abnormality detection aims at localizing and characterising cardiopulmonary radiological findings in the radiographs, which can expedite clinical workflow and reduce observational oversights.…

Anomaly DetectionPseudo Label

Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation

2024-12-18 · Jinghan Sun, Dong Wei, Zhe Xu, Donghuan Lu 외

Anatomical abnormality detection and report generation of chest X-ray (CXR) are two essential tasks in clinical practice. The former aims at localizing and characterizing cardiopulmonary radiological findings in CXRs, wh…

Anomaly Detection

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection

2023-01-01 · ICCV 2023 10 · Zhihao Gu, Liang Liu, Xu Chen, Ran Yi 외

Knowledge distillation (KD) has been widely explored in unsupervised anomaly detection (AD). The student is assumed to constantly produce representations of typical patterns within trained data, named "normality", an…

Anomaly DetectionKnowledge DistillationUnsupervised Anomaly Detection

CLIP the Divergence: Language-guided Unsupervised Domain Adaptation

2024-07-01 · Jinjing Zhu, Yucheng Chen, Lin Wang

Unsupervised domain adaption (UDA) has emerged as a popular solution to tackle the divergence between the labeled source and unlabeled target domains. Recently, some research efforts have been made to leverage large visi…

Domain AdaptationUnsupervised Domain Adaptation

Generalist Graph Anomaly Detection via Prototype-Based Distillation

2026-05-26 · Yiming Xu, Zihan Chen, Zhen Peng, Song Wang 외 arxiv

Driven by the pressing demand for graph anomaly detection (GAD) in high-stakes domains, the generalist GAD paradigm, which trains a single detector transferable across new graphs, has recently gained growing attention. H…

Graph Anomaly DetectionGraph Neural Network