paper-with-me

홈 › Papers

MHITNet: a minimize network with a hierarchical context-attentional filter for segmenting medical ct images

2022-11-01 · Hongyang He, Feng Ziliang, Yuanhang Zheng, Shudong Huang, HaoBing Gao

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent research indicates that self-attention or transformer layers can be stacked to efficiently learn long-range dependencies.By constructing and processing picture patches as embeddings, transformers have been applied to computer vision applications. However, transformer-based architectures lack global semantic information interaction and require a large-scale training dataset, making it challenging to train with small data samples. In order to solve these challenges, we present a hierarchical contextattention transformer network (MHITNet) that combines the multi-scale, transformer, and hierarchical context extraction modules in skip-connections. The multi-scale module captures deeper CT semantic information, enabling transformers to encode feature maps of tokenized picture patches from various CNN stages as input attention sequences more effectively. The hierarchical context attention module augments global data and reweights pixels to capture semantic context.Extensive trials on three datasets show that the proposed MHITNet beats current best practises

📄 PDF Abstract BibTeX arXiv:2211.00700

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Similar Papers 제목 키워드 기반

Learning Reinforced Attentional Representation for End-to-End Visual Tracking

2019-08-27 · Peng Gao, Qiquan Zhang, Fei Wang, Liyi Xiao 외

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to lear…

Visual Tracking

Attentional Correlation Filter Network for Adaptive Visual Tracking

2017-07-21 · IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 7 · Jongwon Choi, Hyung Jin Chang, Sangdoo Yun, Tobias Fischer 외

We propose a new tracking framework with an attentional mechanism that chooses a subset of the associated correlation filters for increased robustness and computational efficiency. The subset of filters is adaptively sel…

Computational EfficiencyVisual Object TrackingVisual Tracking

Deep Attentional Guided Image Filtering

2021-12-13 · Zhiwei Zhong, Xianming Liu, Junjun Jiang, Debin Zhao 외

Guided filter is a fundamental tool in computer vision and computer graphics which aims to transfer structure information from guidance image to target image. Most existing methods construct filter kernels from the guida…

Collaborative FilteringDepth Image UpsamplingDepth Map Super-Resolution

Abstractive Text-Image Summarization Using Multi-Modal Attentional Hierarchical RNN

2018-10-01 · EMNLP 2018 10 · Jingqiang Chen, Hai Zhuge

Rapid growth of multi-modal documents on the Internet makes multi-modal summarization research necessary. Most previous research summarizes texts or images separately. Recent neural summarization research shows the stren…

DecoderExtractive Text SummarizationText Summarization

Bidirectional Context-Aware Hierarchical Attention Network for Document Understanding

2019-08-16 · Jean-Baptiste Remy, Antoine Jean-Pierre Tixier, Michalis Vazirgiannis

The Hierarchical Attention Network (HAN) has made great strides, but it suffers a major limitation: at level 1, each sentence is encoded in complete isolation. In this work, we propose and compare several modifications o…

Abstractive Text Summarizationdocument understandingSentenceTopic Classification