RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion
Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive parameter counts and memory demands, restricting their clinical deployment. We propose RefineFormer3D, a lightweight hierarchical transformer architecture that balances segmentation accuracy and computational efficiency for volumetric medical imaging. The architecture integrates three key components: (i) GhostConv3D-based patch embedding for efficient feature extraction with minimal redundancy, (ii) MixFFN3D module with low-rank projections and depthwise convolutions for parameter-efficient feature extraction, and (iii) a cross-attention fusion decoder enabling adaptive multi-scale skip connection integration. RefineFormer3D contains only 2.94M parameters, substantially fewer than contemporary transformer-based methods. Extensive experiments on ACDC and BraTS benchmarks demonstrate that RefineFormer3D achieves 93.44\% and 85.9\% average Dice scores respectively, outperforming or matching state-of-the-art methods while requiring significantly fewer parameters. Furthermore, the model achieves fast inference (8.35 ms per volume on GPU) with low memory requirements, supporting deployment in resource-constrained clinical environments. These results establish RefineFormer3D as an effective and scalable solution for practical 3D medical image segmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
Medical Image SegmentationComputational EfficiencySimilar Papers 제목 키워드 기반
Expert-Adaptive Medical Image Segmentation
Medical image segmentation (MIS) plays an instrumental role in medical image analysis, where considerable effort has been devoted to automating the process. Currently, mainstream MIS approaches are based on deep neural n…
Brain SegmentationImage SegmentationMedical Image AnalysisMedical Image Segmentation+3Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration
Medical image segmentation is one of the fundamental problems for artificial intelligence-based clinical decision systems. Current automatic medical image segmentation methods are often failed to meet clinical requiremen…
Image SegmentationInteractive SegmentationMedical Image SegmentationMulti-agent Reinforcement Learning+2KA$^2$ER: Knowledge Adaptive Amalgamation of ExpeRts for Medical Images Segmentation
Recently, many foundation models for medical image analysis such as MedSAM, SwinUNETR have been released and proven to be useful in multiple tasks. However, considering the inherent heterogeneity and inhomogeneity of rea…
Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentation+1TAGS: 3D Tumor-Adaptive Guidance for SAM
Foundation models (FMs) such as CLIP and SAM have recently shown great promise in image segmentation tasks, yet their adaptation to 3D medical imaging-particularly for pathology detection and segmentation-remains underex…
AnatomyImage SegmentationInteractive SegmentationMedical Image Segmentation+3Domain and Content Adaptive Convolution based Multi-Source Domain Generalization for Medical Image Segmentation
The domain gap caused mainly by variable medical image quality renders a major obstacle on the path between training a segmentation model in the lab and applying the trained model to unseen clinical data. To address this…
DecoderDomain GeneralizationImage SegmentationLesion Segmentation+4