paper-with-me

홈 › Papers

Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis

2026-05-01 · Shadid Yousuf, S. M. Mahbubur Rahman, Mohammed Imamul Hassan Bhuiyan arxiv

The deployment of artificial intelligence in medical imaging is hindered by high computational complexity and resource-intensive processing of volumetric data. Although chest computed tomography (CT) volumes offer richer diagnostic information than projection radiography, their use in AI-based diagnosis remains limited due to the computational burden of processing uncompressed volumetric images (typically stored in NIfTI or DICOM format). Addressing the growing need for low-resource deployment and efficient electronic data transfer, we investigate the utilization of JPEG-compressed chest CT volumes for thoracic abnormality detection. We propose Feature Attention Style Transfer (FAST), a novel distillation framework that transfers both activation patterns and structural relationships from high-fidelity CT representations to a spatiotemporal visual encoder operating on compressed inputs. By combining Gram-matrix-based attention style preservation with dual-attention feature alignment, FAST enables robust feature extraction from degraded volumes. Furthermore, we introduce Structured Factorized Projection (SFP), leveraging Block Tensor Train decomposition as a parameter-efficient alternative to dense projection layers, reducing projection-head parameters by almost half. Our contrastive learning pipeline, CT-Lite, integrates these components with a SigLIP-based multimodal alignment objective. Experiments on CT-RATE, NIDCH, and Rad-ChestCT demonstrate that CT-Lite achieves AUROC within 5-7\% of the uncompressed-input baseline across all three datasets, despite operating on compressed inputs with significantly fewer parameters, paving the way for AI-based clinical evaluation under resource constraints.

📄 PDF Abstract BibTeX arXiv:2605.00448

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningStyle Transfer

Similar Papers 제목 키워드 기반

itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detection

2022-05-31 · CVPR 2023 1 · Hyeon Cho, Junyong Choi, Geonwoo Baek, Wonjun Hwang

Point-cloud based 3D object detectors recently have achieved remarkable progress. However, most studies are limited to the development of network architectures for improving only their accuracy without consideration of t…

3D Object DetectionCloud DetectionComputational EfficiencyKnowledge Distillation+2

All-to-key Attention for Arbitrary Style Transfer

2022-12-08 · ICCV 2023 1 · Mingrui Zhu, Xiao He, Nannan Wang, Xiaoyu Wang 외

Attention-based arbitrary style transfer studies have shown promising performance in synthesizing vivid local style details. They typically use the all-to-all attention mechanism -- each position of content features is f…

AllPositionStyle Transfer

Style Transfer with Target Feature Palette and Attention Coloring

2021-11-07 · Suhyeon Ha, Guisik Kim, Junseok Kwon

Style transfer has attracted a lot of attentions, as it can change a given image into one with splendid artistic styles while preserving the image structure. However, conventional approaches easily lose image details and…

Style Transfer

AEANet: Affinity Enhanced Attentional Networks for Arbitrary Style Transfer

2024-09-23 · Gen Li, Xianqiu Zheng, Yujian Li

Arbitrary artistic style transfer is a research area that combines rational academic study with emotive artistic creation. It aims to create a new image from a content image according to a target artistic style, maintain…

Style Transfer

AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfer

2021-08-08 · ICCV 2021 10 · Songhua Liu, Tianwei Lin, Dongliang He, Fu Li 외

Fast arbitrary neural style transfer has attracted widespread attention from academic, industrial and art communities due to its flexibility in enabling various applications. Existing solutions either attentively fuse de…

Style TransferVideo Style Transfer