paper-with-me

Papers

HYATT-Net is Grand: A Hybrid Attention Network for Performant Anatomical Landmark Detection

2024-12-09 · Xiaoqian Zhou, Zhen Huang, Heqin Zhu, Qingsong Yao, S. Kevin Zhou

Anatomical landmark detection (ALD) from a medical image is crucial for a wide array of clinical applications. While existing methods achieve quite some success in ALD, they often struggle to balance global context with computational efficiency, particularly with high-resolution images, thereby leading to the rise of a natural question: where is the performance limit of ALD? In this paper, we aim to forge performant ALD by proposing a {\bf HY}brid {\bf ATT}ention {\bf Net}work (HYATT-Net) with the following designs: (i) A novel hybrid architecture that integrates CNNs and Transformers. Its core is the BiFormer module, utilizing Bi-Level Routing Attention for efficient attention to relevant image regions. This, combined with Attention Residual Module(ARM), enables precise local feature refinement guided by the global context. (ii) A Feature Fusion Correction Module that aggregates multi-scale features and thus mitigates a resolution loss. Deep supervision with a mean-square error loss on multi-resolution heatmaps optimizes the model. Experiments on five diverse datasets demonstrate state-of-the-art performance, surpassing existing methods in accuracy, robustness, and efficiency. The HYATT-Net provides a promising solution for accurate and efficient ALD in complex medical images. Our codes and data are already released at: \url{https://github.com/ECNUACRush/HYATT-Net}.

📄 PDF Abstract BibTeX arXiv:2412.06499

Code (1)

ecnuacrush/hyatt-net 공식 구현 pytorch

Tasks

Anatomical Landmark DetectionAnatomyComputational Efficiency

Methods 이 논문이 사용한 방법론

Communication--Guide||How Do I Communicate to Expedia? To make reservations or communicate with Expedia, the quickest option is typically to call their customer service at +1-888-829-0881 or +1(805) 330 (4056) You can also use the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Sigmoid Activation 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Average Pooling 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Neural Control Variates

2020-06-02 · Thomas Müller, Fabrice Rousselle, Jan Novák, Alexander Keller

We propose neural control variates (NCV) for unbiased variance reduction in parametric Monte Carlo integration. So far, the core challenge of applying the method of control variates has been finding a good approximation …

Optimal Information Acquisition Strategies: The Case of Online Lending

2024-10-07 · Mendelson Haim, Zhu Mingxi

Online lending has garnered significant attention in IS literature, particularly platform lending, but direct (balance sheet) lending is increasingly critical. This paper explores optimal information acquisition strategi…

TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Classification from Diffusion MRI Tractography

2024-07-11 · Yuqian Chen, Fan Zhang, Meng Wang, Leo R. Zekelman 외

The relationship between brain connections and non-imaging phenotypes is increasingly studied using deep neural networks. However, the local and global properties of the brain's white matter networks are often overlooked…

Diffusion MRI

Expansion Span: Combining Fading Memory and Retrieval in Hybrid State Space Models

2024-12-17 · Elvis Nunez, Luca Zancato, Benjamin Bowman, Aditya Golatkar 외

The "state" of State Space Models (SSMs) represents their memory, which fades exponentially over an unbounded span. By contrast, Attention-based models have "eidetic" (i.e., verbatim, or photographic) memory over a finit…

RetrievalState Space Models

H-SGANet: Hybrid Sparse Graph Attention Network for Deformable Medical Image Registration

2024-08-29 · Yufeng Zhou, Wenming Cao

The integration of Convolutional Neural Network (ConvNet) and Transformer has emerged as a strong candidate for image registration, leveraging the strengths of both models and a large parameter space. However, this hybri…

Deformable Medical Image RegistrationGPUGraph AttentionGraph Neural Network+2