paper-with-me

Papers

MetaFormer-driven Encoding Network for Robust Medical Semantic Segmentation

2026-01-01 · Le-Anh Tran, Chung Nguyen Tran, Nhan Cach Dang, Anh Le Van Quoc, Jordi Carrabina, David Castells-Rufas, Minh Son Nguyen arxiv

Semantic segmentation is crucial for medical image analysis, enabling precise disease diagnosis and treatment planning. However, many advanced models employ complex architectures, limiting their use in resource-constrained clinical settings. This paper proposes MFEnNet, an efficient medical image segmentation framework that incorporates MetaFormer in the encoding phase of the U-Net backbone. MetaFormer, an architectural abstraction of vision transformers, provides a versatile alternative to convolutional neural networks by transforming tokenized image patches into sequences for global context modeling. To mitigate the substantial computational cost associated with self-attention, the proposed framework replaces conventional transformer modules with pooling transformer blocks, thereby achieving effective global feature aggregation at reduced complexity. In addition, Swish activation is used to achieve smoother gradients and faster convergence, while spatial pyramid pooling is incorporated at the bottleneck to improve multi-scale feature extraction. Comprehensive experiments on different medical segmentation benchmarks demonstrate that the proposed MFEnNet approach attains competitive accuracy while significantly lowering computational cost compared to state-of-the-art models. The source code for this work is available at https://github.com/tranleanh/mfennet.

📄 PDF Abstract BibTeX arXiv:2601.00922

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

MetaSeg: MetaFormer-based Global Contexts-aware Network for Efficient Semantic Segmentation

2024-08-14 · Beoungwoo Kang, Seunghun Moon, Yubin Cho, Hyunwoo Yu 외

Beyond the Transformer, it is important to explore how to exploit the capacity of the MetaFormer, an architecture that is fundamental to the performance improvements of the Transformer. Previous studies have exploited it…

Computational EfficiencyDecoderImage SegmentationMedical Image Segmentation+2

Shaken or Stirred? An Analysis of MetaFormer's Token Mixing for Medical Imaging

2025-10-07 · Ron Keuth, Paul Kaftan, Mattias P. Heinrich arxiv

The generalization of the Transformer architecture via MetaFormer has reshaped our understanding of its success in computer vision. By replacing self-attention with simpler token mixers, MetaFormer provides strong baseli…

Semantic SegmentationImage Classification

M^2UNet: MetaFormer Multi-scale Upsampling Network for Polyp Segmentation

2023-06-14 · Quoc-Huy Trinh, Nhat-Tan Bui, Trong-Hieu Nguyen Mau, Minh-Van Nguyen 외

Polyp segmentation has recently garnered significant attention, and multiple methods have been formulated to achieve commendable outcomes. However, these techniques often confront difficulty when working with the complex…

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

MetaFormer and CNN Hybrid Model for Polyp Image Segmentation

2024-09-16 · IEEE Access 2024 9 · Hyunnam Lee, Joohan Yoo

Transformer-based methods have become dominant in the medical image research field since the Vision Transformer achieved superior performance. Although transformer-based approaches have resolved long-range dependency pro…

BenchmarkingImage SegmentationMedical Image SegmentationSemantic Segmentation

Activation-Free Backbones for Image Recognition: Polynomial Alternatives within MetaFormer-Style Vision Models

2026-05-20 · Jeffrey Wang, Jonathan Gregory, Grigorios G. Chrysos arxiv

Modern vision backbones treat pointwise activations (e.g., ReLU, GELU) and exponential softmax as essential sources of nonlinearity, but we demonstrate they are not required within MetaFormer-style vision backbones. We d…

Semantic Segmentation