paper-with-me

홈 › Papers

A Spatially-Aware Multiple Instance Learning Framework for Digital Pathology

2025-04-24 · Hassan Keshvarikhojasteh, Mihail Tifrea, Sibylle Hess, Josien P. W. Pluim, Mitko Veta

Multiple instance learning (MIL) is a promising approach for weakly supervised classification in pathology using whole slide images (WSIs). However, conventional MIL methods such as Attention-Based Deep Multiple Instance Learning (ABMIL) typically disregard spatial interactions among patches that are crucial to pathological diagnosis. Recent advancements, such as Transformer based MIL (TransMIL), have incorporated spatial context and inter-patch relationships. However, it remains unclear whether explicitly modeling patch relationships yields similar performance gains in ABMIL, which relies solely on Multi-Layer Perceptrons (MLPs). In contrast, TransMIL employs Transformer-based layers, introducing a fundamental architectural shift at the cost of substantially increased computational complexity. In this work, we enhance the ABMIL framework by integrating interaction-aware representations to address this question. Our proposed model, Global ABMIL (GABMIL), explicitly captures inter-instance dependencies while preserving computational efficiency. Experimental results on two publicly available datasets for tumor subtyping in breast and lung cancers demonstrate that GABMIL achieves up to a 7 percentage point improvement in AUPRC and a 5 percentage point increase in the Kappa score over ABMIL, with minimal or no additional computational overhead. These findings underscore the importance of incorporating patch interactions within MIL frameworks. Our code is available at \href{https://github.com/tueimage/GABMIL}{\texttt{GABMIL}}.

📄 PDF Abstract BibTeX arXiv:2504.17379

Code (1)

tueimage/gabmil 공식 구현 pytorch

Tasks

Computational EfficiencyMultiple Instance LearningWeakly Supervised Classificationwhole slide images

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Nuclear Instance Segmentation using a Proposal-Free Spatially Aware Deep Learning Framework

2019-08-27 · Navid Alemi Koohbanani, Mostafa Jahanifar, Ali Gooya, Nasir Rajpoot

Nuclear segmentation in histology images is a challenging task due to significant variations in the shape and appearance of nuclei. One of the main hurdles in nuclear instance segmentation is overlapping nuclei where a s…

ClusteringInstance SegmentationNuclear SegmentationSegmentation+1

PosSAM: Panoptic Open-vocabulary Segment Anything

2024-03-14 · Vibashan VS, Shubhankar Borse, Hyojin Park, Debasmit Das 외

In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP model in an end-to-end framework. While …

DecoderOpen Vocabulary Panoptic SegmentationOpen Vocabulary Semantic SegmentationPanoptic Segmentation+1

Compressive single-pixel imaging via a wavelength-multiplexed spatially incoherent diffractive optical processor

2026-03-23 · Xiao Wang, Yiyang Wu, Yuntian Wang, Md Sadman Sakib Rahman 외 arxiv

Despite offering high sensitivity, a high signal-to-noise ratio, and a broad spectral range, single-pixel imaging (SPI) is limited by low measurement efficiency and long data-acquisition times. To address this, we propos…

Automatic Spatially-aware Fashion Concept Discovery

2017-08-03 · ICCV 2017 10 · Xintong Han, Zuxuan Wu, Phoenix X. Huang, Xiao Zhang 외

This paper proposes an automatic spatially-aware concept discovery approach using weakly labeled image-text data from shopping websites. We first fine-tune GoogleNet by jointly modeling clothing images and their correspo…

AttributeClusteringImage Retrieval with Multi-Modal QueryRetrieval

Grounding Surgical Action Triplets with Instrument Instance Segmentation: A Dataset and Target-Aware Fusion Approach

2025-11-01 · Oluwatosin Alabi, Meng Wei, Charlie Budd, Tom Vercauteren 외 arxiv

Understanding surgical instrument-tissue interactions requires not only identifying which instrument performs which action on which anatomical target, but also grounding these interactions spatially within the surgical s…

Action Triplet RecognitionInstance SegmentationAction UnderstandingScene Understanding