paper-with-me

홈 › Papers

MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathology

2024-03-11 · Shu Yang, Yihui Wang, Hao Chen

Multiple Instance Learning (MIL) has emerged as a dominant paradigm to extract discriminative feature representations within Whole Slide Images (WSIs) in computational pathology. Despite driving notable progress, existing MIL approaches suffer from limitations in facilitating comprehensive and efficient interactions among instances, as well as challenges related to time-consuming computations and overfitting. In this paper, we incorporate the Selective Scan Space State Sequential Model (Mamba) in Multiple Instance Learning (MIL) for long sequence modeling with linear complexity, termed as MambaMIL. By inheriting the capability of vanilla Mamba, MambaMIL demonstrates the ability to comprehensively understand and perceive long sequences of instances. Furthermore, we propose the Sequence Reordering Mamba (SR-Mamba) aware of the order and distribution of instances, which exploits the inherent valuable information embedded within the long sequences. With the SR-Mamba as the core component, MambaMIL can effectively capture more discriminative features and mitigate the challenges associated with overfitting and high computational overhead. Extensive experiments on two public challenging tasks across nine diverse datasets demonstrate that our proposed framework performs favorably against state-of-the-art MIL methods. The code is released at https://github.com/isyangshu/MambaMIL.

📄 PDF Abstract BibTeX arXiv:2403.06800

Code (2)

isyangshu/mambamil 공식 구현 pytorch
isyangshu/surgformer pytorch

Tasks

MambaMultiple Instance Learningwhole slide images

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

MoEMambaMIL: Structure-Aware Selective State Space Modeling for Whole-Slide Image Analysis

2026-03-06 · Dongqing Xie, Yonghuang Wu arxiv

Whole-slide image (WSI) analysis is challenging due to the gigapixel scale of slides and their inherent hierarchical multi-resolution structure. Existing multiple instance learning (MIL) approaches often model WSIs as un…

Multiple Instance Learning

MambaMIL+: Modeling Long-Term Contextual Patterns for Gigapixel Whole Slide Image

2025-12-19 · Qian Zeng, Yihui Wang, Shu Yang, Yingxue Xu 외 arxiv

Whole-slide images (WSIs) are an important data modality in computational pathology, yet their gigapixel resolution and lack of fine-grained annotations challenge conventional deep learning models. Multiple instance lear…

Multiple Instance LearningLong-range modeling

No Length Left Behind: Enhancing Knowledge Tracing for Modeling Sequences of Excessive or Insufficient Lengths

2023-08-07 · Moyu Zhang, Xinning Zhu, Chunhong Zhang, Feng Pan 외

Knowledge tracing (KT) aims to predict students' responses to practices based on their historical question-answering behaviors. However, most current KT methods focus on improving overall AUC, leaving ample room for opti…

Knowledge TracingQuestion Answering

Manta: Enhancing Mamba for Few-Shot Action Recognition of Long Sub-Sequence

2024-12-10 · Wenbo Huang, Jinghui Zhang, Guang Li, Lei Zhang 외

In few-shot action recognition (FSAR), long sub-sequences of video naturally express entire actions more effectively. However, the high computational complexity of mainstream Transformer-based methods limits their applic…

Action RecognitionContrastive LearningFew-Shot action recognitionFew Shot Action Recognition+1

POLLA: Enhancing the Local Structure Awareness in Long Sequence Spatial-temporal Modeling

2021-11-29 · TIST 2021 2021 11 · Haoyi Zhou, Hao Peng, Jieqi Peng, Shuai Zhang 외

The spatial-temporal modeling on long sequences is of great importance in many real-world applications. Recent studies have shown the potential of applying the self-attention mechanism to improve capturing the complex …

Decoder