paper-with-me

Papers

Nested Multiple Instance Learning with Attention Mechanisms

2021-11-01 · Saul Fuster, Trygve Eftestøl, Kjersti Engan

Strongly supervised learning requires detailed knowledge of truth labels at instance levels, and in many machine learning applications this is a major drawback. Multiple instance learning (MIL) is a popular weakly supervised learning method where truth labels are not available at instance level, but only at bag-of-instances level. However, sometimes the nature of the problem requires a more complex description, where a nested architecture of bag-of-bags at different levels can capture underlying relationships, like similar instances grouped together. Predicting the latent labels of instances or inner-bags might be as important as predicting the final bag-of-bags label but is lost in a straightforward nested setting. We propose a Nested Multiple Instance with Attention (NMIA) model architecture combining the concept of nesting with attention mechanisms. We show that NMIA performs as conventional MIL in simple scenarios and can grasp a complex scenario providing insights to the latent labels at different levels.

📄 PDF Abstract BibTeX arXiv:2111.00947

Code (1)

Biomedical-Data-Analysis-Laboratory/NMIL_Attention tf

Tasks

Multiple Instance LearningTime Series AnalysisWeakly-supervised Learning

Similar Papers 제목 키워드 기반

Attention-Challenging Multiple Instance Learning for Whole Slide Image Classification

2023-11-13 · Yunlong Zhang, Honglin Li, Yuxuan Sun, Sunyi Zheng 외

In the application of Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) classification, attention mechanisms often focus on a subset of discriminative instances, which are closely linked to overfitting…

image-classificationImage ClassificationMultiple Instance Learning

NestedMorph: Enhancing Deformable Medical Image Registration with Nested Attention Mechanisms

2024-10-03 · Gurucharan Marthi Krishna Kumar, Janine Mendola, Amir Shmuel

Deformable image registration is crucial for aligning medical images in a nonlinear fashion across different modalities, allowing for precise spatial correspondence between varying anatomical structures. This paper prese…

DecoderDeformable Medical Image RegistrationDiffusion MRIImage Registration+2

Nexus: Higher-Order Attention Mechanisms in Transformers

2025-12-03 · Hanting Chen, Chong Zhu, Kai Han, Yuchuan Tian 외 arxiv

Transformers have achieved significant success across various domains, relying on self-attention to capture dependencies. However, the standard first-order attention mechanism is often limited by a low-rank bottleneck, s…

TDAF: Top-Down Attention Framework for Vision Tasks

2020-12-14 · Bo Pang, Yizhuo Li, Jiefeng Li, Muchen Li 외

Human attention mechanisms often work in a top-down manner, yet it is not well explored in vision research. Here, we propose the Top-Down Attention Framework (TDAF) to capture top-down attentions, which can be easily ado…

Action Recognitionobject-detectionObject DetectionPose Estimation

Rethinking the Nested U-Net Approach: Enhancing Biomarker Segmentation with Attention Mechanisms and Multiscale Feature Fusion

2025-04-08 · Saad Wazir, Daeyoung Kim

Identifying biomarkers in medical images is vital for a wide range of biotech applications. However, recent Transformer and CNN based methods often struggle with variations in morphology and staining, which limits their …

2D Semantic SegmentationImage SegmentationMedical Image SegmentationSemantic Segmentation