paper-with-me

홈 › Papers

Seg-LSTM: Performance of xLSTM for Semantic Segmentation of Remotely Sensed Images

2024-06-20 · Qinfeng Zhu, Yuanzhi Cai, Lei Fan

Recent advancements in autoregressive networks with linear complexity have driven significant research progress, demonstrating exceptional performance in large language models. A representative model is the Extended Long Short-Term Memory (xLSTM), which incorporates gating mechanisms and memory structures, performing comparably to Transformer architectures in long-sequence language tasks. Autoregressive networks such as xLSTM can utilize image serialization to extend their application to visual tasks such as classification and segmentation. Although existing studies have demonstrated Vision-LSTM's impressive results in image classification, its performance in image semantic segmentation remains unverified. Our study represents the first attempt to evaluate the effectiveness of Vision-LSTM in the semantic segmentation of remotely sensed images. This evaluation is based on a specifically designed encoder-decoder architecture named Seg-LSTM, and comparisons with state-of-the-art segmentation networks. Our study found that Vision-LSTM's performance in semantic segmentation was limited and generally inferior to Vision-Transformers-based and Vision-Mamba-based models in most comparative tests. Future research directions for enhancing Vision-LSTM are recommended. The source code is available from https://github.com/zhuqinfeng1999/Seg-LSTM.

📄 PDF Abstract BibTeX arXiv:2406.14086

Code (1)

zhuqinfeng1999/seg-lstm 공식 구현

Tasks

Decoderimage-classificationImage ClassificationMambaSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart

2024-07-01 · Tianrun Chen, Chaotao Ding, Lanyun Zhu, Tao Xu 외

Convolutional Neural Networks (CNNs) and Vision Transformers (ViT) have been pivotal in biomedical image segmentation, yet their ability to manage long-range dependencies remains constrained by inherent locality and comp…

3D Medical Imaging Segmentationimage-classificationImage ClassificationImage Segmentation+5

Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?

2024-06-24 · Pallabi Dutta, Soham Bose, Swalpa Kumar Roy, Sushmita Mitra

The development of efficient segmentation strategies for medical images has evolved from its initial dependence on Convolutional Neural Networks (CNNs) to the current investigation of hybrid models that combine CNNs with…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation

2024-11-14 · Zhuoyi Fang, Jiajia Liu, Kexuan Shi, Qiang Han

Automatic melanoma segmentation is essential for early skin cancer detection, yet challenges arise from the heterogeneity of melanoma, as well as interfering factors like blurred boundaries, low contrast, and imaging art…

Computational EfficiencyLesion SegmentationMambaSegmentation+1

XLSTM-HVED: Cross-Modal Brain Tumor Segmentation and MRI Reconstruction Method Using Vision XLSTM and Heteromodal Variational Encoder-Decoder

2024-12-09 · Shenghao Zhu, Yifei Chen, Shuo Jiang, Weihong Chen 외

Neurogliomas are among the most aggressive forms of cancer, presenting considerable challenges in both treatment and monitoring due to their unpredictable biological behavior. Magnetic resonance imaging (MRI) is currentl…

Brain Tumor SegmentationDecoderMRI ReconstructionSegmentation+1

MAL: Cluster-Masked and Multi-Task Pretraining for Enhanced xLSTM Vision Performance

2024-12-14 · Wenjun Huang, Jianguo Hu

The Long Short-Term Memory (LSTM) networks have traditionally faced challenges in scaling and effectively capturing complex dependencies in visual tasks. The xLSTM architecture has emerged to address these limitations, i…

DecoderDepth EstimationImage SegmentationSemantic Segmentation