paper-with-me

홈 › Papers

LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurring

2023-02-21 · Zhihao Chen, Chuang Niu, Qi Gao, Ge Wang, Hongming Shan

This paper studies 3D low-dose computed tomography (CT) imaging. Although various deep learning methods were developed in this context, typically they focus on 2D images and perform denoising due to low-dose and deblurring for super-resolution separately. Up to date, little work was done for simultaneous in-plane denoising and through-plane deblurring, which is important to obtain high-quality 3D CT images with lower radiation and faster imaging speed. For this task, a straightforward method is to directly train an end-to-end 3D network. However, it demands much more training data and expensive computational costs. Here, we propose to link in-plane and through-plane transformers for simultaneous in-plane denoising and through-plane deblurring, termed as LIT-Former, which can efficiently synergize in-plane and through-plane sub-tasks for 3D CT imaging and enjoy the advantages of both convolution and transformer networks. LIT-Former has two novel designs: efficient multi-head self-attention modules (eMSM) and efficient convolutional feedforward networks (eCFN). First, eMSM integrates in-plane 2D self-attention and through-plane 1D self-attention to efficiently capture global interactions of 3D self-attention, the core unit of transformer networks. Second, eCFN integrates 2D convolution and 1D convolution to extract local information of 3D convolution in the same fashion. As a result, the proposed LIT-Former synergize these two subtasks, significantly reducing the computational complexity as compared to 3D counterparts and enabling rapid convergence. Extensive experimental results on simulated and clinical datasets demonstrate superior performance over state-of-the-art models. The source code is made available at https://github.com/hao1635/LIT-Former.

📄 PDF Abstract BibTeX arXiv:2302.10630

Code (1)

hao1635/lit-former 공식 구현 pytorch

Tasks

Computed Tomography (CT)DeblurringDenoisingImage DenoisingSuper-Resolution

Methods 이 논문이 사용한 방법론

3D Convolution A 3D Convolution is a type of convolution where the kernel slides in 3 dimensions as opposed to 2 dimensions with 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

PlaneTR: Structure-Guided Transformers for 3D Plane Recovery

2021-07-27 · ICCV 2021 10 · Bin Tan, Nan Xue, Song Bai, Tianfu Wu 외

This paper presents a neural network built upon Transformers, namely PlaneTR, to simultaneously detect and reconstruct planes from a single image. Different from previous methods, PlaneTR jointly leverages the context in…

Decoder

Exoplanet Transit Candidate Identification in TESS Full-Frame Images via a Transformer-Based Algorithm

2025-02-11 · Helem Salinas, Rafael Brahm, Greg Olmschenk, Richard K. Barry 외

The Transiting Exoplanet Survey Satellite (TESS) is surveying a large fraction of the sky, generating a vast database of photometric time series data that requires thorough analysis to identify exoplanetary transit signa…

Time Series

SPPSFormer: High-quality Superpoint-based Transformer for Roof Plane Instance Segmentation from Point Clouds

2025-05-30 · Cheng Zeng, Xiatian Qi, Chi Chen, Kai Sun 외

Transformers have been seldom employed in point cloud roof plane instance segmentation, which is the focus of this study, and existing superpoint Transformers suffer from limited performance due to the use of low-quality…

Data AugmentationInstance SegmentationPlane Instance SegmentationSemantic Segmentation

Temporal Triplane Transformers as Occupancy World Models

2025-03-10 · Haoran Xu, Peixi Peng, Guang Tan, Yiqian Chang 외

World models aim to learn or construct representations of the environment that enable the prediction of future scenes, thereby supporting intelligent motion planning. However, existing models often struggle to produce fi…

Autonomous DrivingMotion Planning

UniPlane: Unified Plane Detection and Reconstruction from Posed Monocular Videos

2024-07-04 · Yuzhong Huang, Chen Liu, Ji Hou, Ke Huo 외

We present UniPlane, a novel method that unifies plane detection and reconstruction from posed monocular videos. Unlike existing methods that detect planes from local observations and associate them across the video for …