paper-with-me

Papers

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification

2026-06-18 · Muhammad Azeem, Tanveer Hussain, Amr Ahmed, Ardhendu Behera arxiv

Automated skin cancer classification from dermoscopic images remains challenging due to heterogeneous lesion structure, strong intra-class variability, and subtle visual differences between benign and malignant cases. Existing CNN/ViT pipelines typically rely on global or patch-level features and often combine patient metadata via late fusion, which limits spatially grounded multimodal reasoning. We present a novel region-based graph learning framework that explicitly models lesions as graphs of spatially coherent superpixel regions represented as frozen CNN features. To capture fine-grained lesion arrangements, we encode inter-regional geometry as edge attributes and introduce a dedicated metadata context node connected to all regions, providing structured integration of demographic/clinical variables within the same relational space. Node representations are updated using our edge-aware graph transformer followed by attention-driven propagation, and a final graph-level embedding for benign-malignant classification. Experiments on four public benchmarks demonstrate that explicit region-level relational modeling and graph-native multimodal fusion yield consistent gains over the state-of-the-art. Consequently, we establish a new graph-centric perspective in which CNN features are modeled as relational nodes and improved through contextual integration, yielding more expressive and robust classifications.

📄 PDF Abstract BibTeX arXiv:2606.20390

Code (0)

등록된 구현이 없습니다.

Tasks

Skin Lesion ClassificationSkin Cancer ClassificationMultimodal ReasoningGraph Learning

Similar Papers 제목 키워드 기반

Is an Image Also Worth 16x16=256 Superpixels? A Framework for Attentional Image Classification

2026-05-26 · Pedro Henrique da Costa Avelar, Anderson R. Tavares, Luís C. Lamb arxiv

Superpixel-based image classification has traditionally leveraged graph neural networks (GNNs) for processing irregular image representations. Recent advances in computer vision, driven by Vision Transformers (ViTs), hav…

Superpixel Image ClassificationDomain Generalization

Deep Spatially-Regularized and Superpixel-Based Diffusion Learning for Unsupervised Hyperspectral Image Clustering

2026-04-14 · Vutichart Buranasiri, James M. Murphy arxiv

An unsupervised framework for hyperspectral image (HSI) clustering is proposed that incorporates masked deep representation learning with diffusion-based clustering, extending the Spatially-Regularized Superpixel-based D…

Representation LearningImage Clustering

Superpixel Tokenization for Vision Transformers: Preserving Semantic Integrity in Visual Tokens

2024-12-06 · Jaihyun Lew, Soohyuk Jang, Jaehoon Lee, Seungryong Yoo 외

Transformers, a groundbreaking architecture proposed for Natural Language Processing (NLP), have also achieved remarkable success in Computer Vision. A cornerstone of their success lies in the attention mechanism, which …

Superpixels

GraphDerm: Fusing Imaging, Physical Scale, and Metadata in a Population-Graph Classifier for Dermoscopic Lesions

2025-09-14 · Mehdi Yousefzadeh, Parsa Esfahanian, Sara Rashidifar, Hossein Salahshoor Gavalan 외 arxiv

Introduction. Dermoscopy aids melanoma triage, yet image-only AI often ignores patient metadata (age, sex, site) and the physical scale needed for geometric analysis. We present GraphDerm, a population-graph framework th…

Lesion SegmentationNode Classification

On Preserving Geometrical Invariance for Superpixel Image Classification using Graph Transformer

2026-07-05 · Sarabeshwar Balaji, Shubham Mohanty, Akash Anil arxiv

Convolutional Neural Network (CNN) and Vision Transformer (ViT) for image classification exploit a dense grid of pixels containing redundant information. Consequently, for a larger image dataset, CNNs and ViTs face deplo…

Superpixel Image Classification