paper-with-me

홈 › Papers

Parameter-Free Bio-Inspired Channel Attention for Enhanced Cardiac MRI Reconstruction

2025-05-29 · Anam Hashmi, Julia Dietlmeier, Kathleen M. Curran, Noel E. O'Connor

Attention is a fundamental component of the human visual recognition system. The inclusion of attention in a convolutional neural network amplifies relevant visual features and suppresses the less important ones. Integrating attention mechanisms into convolutional neural networks enhances model performance and interpretability. Spatial and channel attention mechanisms have shown significant advantages across many downstream tasks in medical imaging. While existing attention modules have proven to be effective, their design often lacks a robust theoretical underpinning. In this study, we address this gap by proposing a non-linear attention architecture for cardiac MRI reconstruction and hypothesize that insights from ecological principles can guide the development of effective and efficient attention mechanisms. Specifically, we investigate a non-linear ecological difference equation that describes single-species population growth to devise a parameter-free attention module surpassing current state-of-the-art parameter-free methods.

📄 PDF Abstract BibTeX arXiv:2505.23872

Code (0)

등록된 구현이 없습니다.

Tasks

MRI Reconstruction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

DEA-Net: Single image dehazing based on detail-enhanced convolution and content-guided attention

2023-01-12 · Zixuan Chen, Zewei He, Zhe-Ming Lu

Single image dehazing is a challenging ill-posed problem which estimates latent haze-free images from observed hazy images. Some existing deep learning based methods are devoted to improving the model performance via inc…

Image Dehazing

Parameter-Free Channel Attention for Image Classification and Super-Resolution

2023-03-20 · Yuxuan Shi, Lingxiao Yang, Wangpeng An, XianTong Zhen 외

The channel attention mechanism is a useful technique widely employed in deep convolutional neural networks to boost the performance for image processing tasks, eg, image classification and image super-resolution. It is …

Classificationimage-classificationImage ClassificationImage Super-Resolution+1

STEAM: Squeeze and Transform Enhanced Attention Module

2024-12-12 · Rishabh Sabharwal, Ram Samarth B B, Parikshit Singh Rathore, Punit Rathore

Channel and spatial attention mechanisms introduced by earlier works enhance the representation abilities of deep convolutional neural networks (CNNs) but often lead to increased parameter and computation costs. While re…

image-classificationImage ClassificationInstance Segmentationobject-detection+2

Mixed Attention Transformer Enhanced Channel Estimation for Extremely Large-Scale MIMO Systems

2024-10-18 · Shuang shuang Li, Peihao Dong

Extremely large-scale massive multiple-input multiple-output (XL-MIMO) is one of the key technologies for next-generation wireless communication systems. However, acquiring the accurate high-dimensional channel matrix of…

Feature Importance

Optimization-Inspired Cross-Attention Transformer for Compressive Sensing

2023-04-27 · CVPR 2023 1 · Jiechong Song, Chong Mou, Shiqi Wang, Siwei Ma 외

By integrating certain optimization solvers with deep neural networks, deep unfolding network (DUN) with good interpretability and high performance has attracted growing attention in compressive sensing (CS). However, ex…

Compressive Sensing