paper-with-me

Papers

HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation

2025-04-14 · Tran Quoc Khanh Le, Nguyen Lan Vi Vu, Ha-Hieu Pham, Xuan-Loc Huynh, Tien-Huy Nguyen, Minh Huu Nhat Le, Quan Nguyen, Hien D. Nguyen

Transvaginal ultrasound is a critical imaging modality for evaluating cervical anatomy and detecting physiological changes. However, accurate segmentation of cervical structures remains challenging due to low contrast, shadow artifacts, and indistinct boundaries. While convolutional neural networks (CNNs) have demonstrated efficacy in medical image segmentation, their reliance on large-scale annotated datasets presents a significant limitation in clinical ultrasound imaging. Semi-supervised learning (SSL) offers a potential solution by utilizing unlabeled data, yet existing teacher-student frameworks often encounter confirmation bias and high computational costs. In this paper, a novel semi-supervised segmentation framework, called HDC, is proposed incorporating adaptive consistency learning with a single-teacher architecture. The framework introduces a hierarchical distillation mechanism with two objectives: Correlation Guidance Loss for aligning feature representations and Mutual Information Loss for stabilizing noisy student learning. The proposed approach reduces model complexity while enhancing generalization. Experiments on fetal ultrasound datasets, FUGC and PSFH, demonstrate competitive performance with reduced computational overhead compared to multi-teacher models.

📄 PDF Abstract BibTeX arXiv:2504.09876

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyImage SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RandAugment 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Noisy Student 설명 없음

Similar Papers 제목 키워드 기반

Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation

2022-08-22 · Jie Qin, Jie Wu, Ming Li, Xuefeng Xiao 외

Albeit with varying degrees of progress in the field of Semi-Supervised Semantic Segmentation, most of its recent successes are involved in unwieldy models and the lightweight solution is still not yet explored. We find …

Knowledge DistillationSemantic SegmentationSemi-Supervised Semantic Segmentation

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training

2026-06-18 · Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg 외 arxiv

Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of rea…

Knowledge Distillation3D Object DetectionAutonomous Driving

Multi-scale Latent Point Consistency Models for 3D Shape Generation

2024-12-27 · Bi'an Du, Wei Hu, Renjie Liao

Consistency Models (CMs) have significantly accelerated the sampling process in diffusion models, yielding impressive results in synthesizing high-resolution images. To explore and extend these advancements to point-clou…

3D Shape GenerationDiversity

BAHSD: Bridging the Long-tail Gap via Adaptive Distillation in Black-box Sequential Recommendation

2026-06-02 · Xi Zhou, Famin Wu, Mingming Li, Hongyue Zhang 외 arxiv

Sequential recommendation systems are widely adopted but often deployed as black-box APIs, which has driven recent interest in model extraction to replicate their capabilities locally. However, the long-tail distribution…

Sequential RecommendationContrastive LearningModel extraction

Position-Invariant Truecasing with a Word-and-Character Hierarchical Recurrent Neural Network

2021-08-26 · Hao Zhang, You-Chi Cheng, Shankar Kumar, Mingqing Chen 외

Truecasing is the task of restoring the correct case (uppercase or lowercase) of noisy text generated either by an automatic system for speech recognition or machine translation or by humans. It improves the performance …

Language ModelingLanguage ModellingMachine Translationnamed-entity-recognition+7