paper-with-me

홈 › Papers

CFPFormer: Feature-pyramid like Transformer Decoder for Segmentation and Detection

2024-04-23 · Hongyi Cai, Mohammad Mahdinur Rahman, Jingyu Wu, Yulun Deng

Feature pyramids have been widely adopted in convolutional neural networks (CNNs) and transformers for tasks like medical image segmentation and object detection. However, the currently existing models generally focus on the Encoder-side Transformer to extract features, from which decoder improvement can bring further potential with well-designed architecture. We propose CFPFormer, a novel decoder block that integrates feature pyramids and transformers. Specifically, by leveraging patch embedding, cross-layer feature concatenation, and Gaussian attention mechanisms, CFPFormer enhances feature extraction capabilities while promoting generalization across diverse tasks. Benefiting from Transformer structure and U-shaped Connections, our introduced model gains the ability to capture long-range dependencies and effectively up-sample feature maps. Our model achieves superior performance in detecting small objects compared to existing methods. We evaluate CFPFormer on medical image segmentation datasets and object detection benchmarks (VOC 2007, VOC2012, MS-COCO), demonstrating its effectiveness and versatility. On the ACDC Post-2017-MICCAI-Challenge online test set, our model reaches exceptionally impressive accuracy, and performed well compared with the original decoder setting in Synapse multi-organ segmentation dataset.

📄 PDF Abstract BibTeX arXiv:2404.15451

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage SegmentationMedical Image Segmentationobject-detectionObject DetectionOrgan SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

VPNeXt -- Rethinking Dense Decoding for Plain Vision Transformer

2025-02-23 · Xikai Tang, Ye Huang, Guangqiang Yin, Lixin Duan

We present VPNeXt, a new and simple model for the Plain Vision Transformer (ViT). Unlike the many related studies that share the same homogeneous paradigms, VPNeXt offers a fresh perspective on dense representation based…

DecoderSemantic Segmentation

Leveraging Transformer Decoder for Automotive Radar Object Detection

2026-01-19 · Changxu Zhang, Zhaoze Wang, Tai Fei, Christopher Grimm 외 arxiv

In this paper, we present a Transformer-based architecture for 3D radar object detection that uses a novel Transformer Decoder as the prediction head to directly regress 3D bounding boxes and class scores from radar feat…

Object Detection

QTSeg: A Query Token-Based Architecture for Efficient 2D Medical Image Segmentation

2024-12-23 · Phuong-Nam Tran, Nhat Truong Pham, Duc Ngoc Minh Dang, Eui-Nam Huh 외

Medical image segmentation is crucial in assisting medical doctors in making diagnoses and enabling accurate automatic diagnosis. While advanced convolutional neural networks (CNNs) excel in segmenting regions of interes…

Breast Cancer DetectionDecoderImage SegmentationMedical Image Segmentation+2

Pyramid Fusion Transformer for Semantic Segmentation

2022-01-11 · Zipeng Qin, Jianbo Liu, Xiaolin Zhang, Maoqing Tian 외

The recently proposed MaskFormer gives a refreshed perspective on the task of semantic segmentation: it shifts from the popular pixel-level classification paradigm to a mask-level classification method. In essence, it ge…

DecoderSegmentationSemantic Segmentation

Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers

2023-03-26 · CVPR 2023 1 · Zhou Huang, Hang Dai, Tian-Zhu Xiang, Shuo Wang 외

Vision transformers have recently shown strong global context modeling capabilities in camouflaged object detection. However, they suffer from two major limitations: less effective locality modeling and insufficient feat…

DecoderObjectobject-detectionObject Detection