Unsupervised Medical Image Alignment with Curriculum Learning
We explore different curriculum learning methods for training convolutional neural networks on the task of deformable pairwise 3D medical image registration. To the best of our knowledge, we are the first to attempt to improve performance by training medical image registration models using curriculum learning, starting from an easy training setup in the first training stages, and gradually increasing the complexity of the setup. On the one hand, we consider two existing curriculum learning approaches, namely curriculum dropout and curriculum by smoothing. On the other hand, we propose a novel and simple strategy to achieve curriculum, namely to use purposely blurred images at the beginning, then gradually transit to sharper images in the later training stages. Our experiments with an underlying state-of-the-art deep learning model show that curriculum learning can lead to superior results compared to conventional training. Additionally, we show that curriculum by input blur has the best accuracy versus speed trade-off among the compared curriculum learning approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RegistrationMedical Image RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
Vision-and-Language (V+L) pre-training models have achieved tremendous success in recent years on various multi-modal benchmarks. However, the majority of existing models require pre-training on a large set of parallel i…
RetrievalSentenceTAGVisual Entailment+1See Through the Fog: Curriculum Learning with Progressive Occlusion in Medical Imaging
In recent years, deep learning models have revolutionized medical image interpretation, offering substantial improvements in diagnostic accuracy. However, these models often struggle with challenging images where critica…
DiagnosticReliable Multi-modal Medical Image-to-image Translation Independent of Pixel-wise Aligned Data
The current mainstream multi-modal medical image-to-image translation methods face a contradiction. Supervised methods with outstanding performance rely on pixel-wise aligned training data to constrain the model optimiza…
Image RegistrationImage-to-Image TranslationMedical Image RegistrationModel Optimization+1Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
Unsupervised domain adaptation has increasingly gained interest in medical image computing, aiming to tackle the performance degradation of deep neural networks when being deployed to unseen data with heterogeneous chara…
Domain AdaptationImage SegmentationMedical Image SegmentationOrgan Segmentation+3Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcare
Large Language Models (LLMs) have introduced a new era of proficiency in comprehending complex healthcare and biomedical topics. However, there is a noticeable lack of models in languages other than English and models th…
Language ModelingLanguage Modelling