paper-with-me

홈 › Papers

SS-CTML: Self-Supervised Cross-Task Mutual Learning for CT Image Reconstruction

2024-12-31 · Gaofeng Chen, Yaoduo Zhang, Li Huang, Pengfei Wang, Wenyu Zhang, Dong Zeng, Jianhua Ma, Ji He

Supervised deep-learning (SDL) techniques with paired training datasets have been widely studied for X-ray computed tomography (CT) image reconstruction. However, due to the difficulties of obtaining paired training datasets in clinical routine, the SDL methods are still away from common uses in clinical practices. In recent years, self-supervised deep-learning (SSDL) techniques have shown great potential for the studies of CT image reconstruction. In this work, we propose a self-supervised cross-task mutual learning (SS-CTML) framework for CT image reconstruction. Specifically, a sparse-view scanned and a limited-view scanned sinogram data are first extracted from a full-view scanned sinogram data, which results in three individual reconstruction tasks, i.e., the full-view CT (FVCT) reconstruction, the sparse-view CT (SVCT) reconstruction, and limited-view CT (LVCT) reconstruction. Then, three neural networks are constructed for the three reconstruction tasks. Considering that the ultimate goals of the three tasks are all to reconstruct high-quality CT images, we therefore construct a set of cross-task mutual learning objectives for the three tasks, in which way, the three neural networks can be self-supervised optimized by learning from each other. Clinical datasets are adopted to evaluate the effectiveness of the proposed framework. Experimental results demonstrate that the SS-CTML framework can obtain promising CT image reconstruction performance in terms of both quantitative and qualitative measurements.

📄 PDF Abstract BibTeX arXiv:2501.01456

Code (0)

등록된 구현이 없습니다.

Tasks

Computed Tomography (CT)Image Reconstruction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution

2022-07-19 · Xiaoyu Dong, Naoto Yokoya, Longguang Wang, Tatsumi Uezato

Self-supervised cross-modal super-resolution (SR) can overcome the difficulty of acquiring paired training data, but is challenging because only low-resolution (LR) source and high-resolution (HR) guide images from diffe…

Super-Resolution

Self-Supervised Representation Learning From Multi-Domain Data

2019-10-01 · ICCV 2019 10 · Zeyu Feng, Chang Xu, Dacheng Tao

We present an information-theoretically motivated constraint for self-supervised representation learning from multiple related domains. In contrast to previous self-supervised learning methods, our approach learns from m…

Representation LearningSelf-Supervised LearningTransfer Learning

Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective

2024-01-16 · Alexander H. Liu, Sung-Lin Yeh, James Glass

Existing studies on self-supervised speech representation learning have focused on developing new training methods and applying pre-trained models for different applications. However, the quality of these models is often…

Representation LearningSelf-Supervised Learningspeech-recognitionSpeech Recognition+1

Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task Learning with Auxiliary Mutual Information Maximization

2023-11-07 · Cam-Van Thi Nguyen, Ngoc-Hoa Thi Nguyen, Duc-Trong Le, Quang-Thuy Ha

Multimodal representation learning poses significant challenges in capturing informative and distinct features from multiple modalities. Existing methods often struggle to exploit the unique characteristics of each modal…

Multi-Task LearningRepresentation LearningSelf-Supervised Learning

A Mutual Information Maximization Perspective of Language Representation Learning

2019-10-18 · ICLR 2020 1 · Lingpeng Kong, Cyprien de Masson d'Autume, Wang Ling, Lei Yu 외

We show state-of-the-art word representation learning methods maximize an objective function that is a lower bound on the mutual information between different parts of a word sequence (i.e., a sentence). Our formulation …

Representation LearningSentence