paper-with-me

Papers

Attention-based Dynamic Subspace Learners for Medical Image Analysis

2022-06-18 · Sukesh Adiga V, Jose Dolz, Herve Lombaert

Learning similarity is a key aspect in medical image analysis, particularly in recommendation systems or in uncovering the interpretation of anatomical data in images. Most existing methods learn such similarities in the embedding space over image sets using a single metric learner. Images, however, have a variety of object attributes such as color, shape, or artifacts. Encoding such attributes using a single metric learner is inadequate and may fail to generalize. Instead, multiple learners could focus on separate aspects of these attributes in subspaces of an overarching embedding. This, however, implies the number of learners to be found empirically for each new dataset. This work, Dynamic Subspace Learners, proposes to dynamically exploit multiple learners by removing the need of knowing apriori the number of learners and aggregating new subspace learners during training. Furthermore, the visual interpretability of such subspace learning is enforced by integrating an attention module into our method. This integrated attention mechanism provides a visual insight of discriminative image features that contribute to the clustering of image sets and a visual explanation of the embedding features. The benefits of our attention-based dynamic subspace learners are evaluated in the application of image clustering, image retrieval, and weakly supervised segmentation. Our method achieves competitive results with the performances of multiple learners baselines and significantly outperforms the classification network in terms of clustering and retrieval scores on three different public benchmark datasets. Moreover, our attention maps offer a proxy-labels, which improves the segmentation accuracy up to 15% in Dice scores when compared to state-of-the-art interpretation techniques.

📄 PDF Abstract BibTeX arXiv:2206.09068

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringImage ClusteringImage RetrievalMedical Image AnalysisRecommendation SystemsRetrievalWeakly supervised segmentation

Similar Papers 제목 키워드 기반

Devil is in the Uniformity: Exploring Diverse Learners within Transformer for Image Restoration

2025-03-26 · Shihao Zhou, Dayu Li, Jinshan Pan, Juncheng Zhou 외

Transformer-based approaches have gained significant attention in image restoration, where the core component, i.e, Multi-Head Attention (MHA), plays a crucial role in capturing diverse features and recovering high-quali…

DenoisingImage RestorationRain Removal

DenoDet: Attention as Deformable Multi-Subspace Feature Denoising for Target Detection in SAR Images

2024-06-05 · Yimian Dai, Minrui Zou, YuXuan Li, Xiang Li 외

Synthetic Aperture Radar (SAR) target detection has long been impeded by inherent speckle noise and the prevalence of diminutive, ambiguous targets. While deep neural networks have advanced SAR target detection, their in…

2D Object DetectionDenoisingImage Denoising

A Fast and Efficient Modern BERT based Text-Conditioned Diffusion Model for Medical Image Segmentation

2025-11-26 · Venkata Siddharth Dhara, Pawan Kumar arxiv

In recent times, denoising diffusion probabilistic models (DPMs) have proven effective for medical image generation and denoising, and as representation learners for downstream segmentation. However, segmentation perform…

Medical Image SegmentationMedical Image GenerationClinical Knowledge

Meta-Learners for Few-Shot Weakly-Supervised Medical Image Segmentation

2023-05-11 · Hugo Oliveira, Pedro H. T. Gama, Isabelle Bloch, Roberto Marcondes Cesar Jr

Most uses of Meta-Learning in visual recognition are very often applied to image classification, with a relative lack of works in other tasks {such} as segmentation and detection. We propose a generic Meta-Learning frame…

image-classificationImage ClassificationImage SegmentationMedical Image Segmentation+5

Wings: Learning Multimodal LLMs without Text-only Forgetting

2024-06-05 · Yi-Kai Zhang, Shiyin Lu, Yang Li, Yanqing Ma 외

Multimodal large language models (MLLMs), initiated with a trained LLM, first align images with text and then fine-tune on multimodal mixed inputs. However, the MLLM catastrophically forgets the text-only instructions, w…

Question AnsweringVisual Question Answering