paper-with-me

홈 › Papers

Multimodal Deep Learning for Phyllodes Tumor Classification from Ultrasound and Clinical Data

2025-08-29 · Farhan Fuad Abir, Abigail Elliott Daly, Kyle Anderman, Tolga Ozmen, Laura J. Brattain arxiv

Phyllodes tumors (PTs) are rare fibroepithelial breast lesions that are difficult to classify preoperatively due to their radiological similarity to benign fibroadenomas. This often leads to unnecessary surgical excisions. To address this, we propose a multimodal deep learning framework that integrates breast ultrasound (BUS) images with structured clinical data to improve diagnostic accuracy. We developed a dual-branch neural network that extracts and fuses features from ultrasound images and patient metadata from 81 subjects with confirmed PTs. Class-aware sampling and subject-stratified 5-fold cross-validation were applied to prevent class imbalance and data leakage. The results show that our proposed multimodal method outperforms unimodal baselines in classifying benign versus borderline/malignant PTs. Among six image encoders, ConvNeXt and ResNet18 achieved the best performance in the multimodal setting, with AUC-ROC scores of 0.9427 and 0.9349, and F1-scores of 0.6720 and 0.7294, respectively. This study demonstrates the potential of multimodal AI to serve as a non-invasive diagnostic tool, reducing unnecessary biopsies and improving clinical decision-making in breast tumor management.

📄 PDF Abstract BibTeX arXiv:2509.00213

Code (0)

등록된 구현이 없습니다.

Tasks

Multimodal Deep Learning

Similar Papers 제목 키워드 기반

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

2026-07-02 · Chuxi Nan, Di Wu, Hongming Guo, Ning Cao 외 arxiv

Breast fibroadenoma (FA) and phyllodes tumor (PT) are fibroepithelial breast lesions with highly overlapping appearances on B-mode ultrasound, making benign and borderline PT prone to being misclassified as FA and compli…

Representation Learning

ViTaL: A Multimodality Dataset and Benchmark for Multi-pathological Ovarian Tumor Recognition

2025-07-06 · You Zhou, Lijiang Chen, Guangxia Cui, Wenpei Bai 외 arxiv

Ovarian tumor, as a common gynecological disease, can rapidly deteriorate into serious health crises when undetected early, thus posing significant threats to the health of women. Deep neural networks have the potential …

Breast Ultrasound Tumor Generation via Mask Generator and Text-Guided Network:A Clinically Controllable Framework with Downstream Evaluation

2025-07-10 · Haoyu Pan, Hongxin Lin, Zetian Feng, Chuxuan Lin 외 arxiv

The development of robust deep learning models for breast ultrasound (BUS) image analysis is significantly constrained by the scarcity of expert-annotated data. To address this limitation, we propose a clinically control…

U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding

2025-05-23 · Anjie Le, Henan Liu, Yue Wang, Zhenyu Liu 외

Ultrasound is a widely-used imaging modality critical to global healthcare, yet its interpretation remains challenging due to its varying image quality on operators, noises, and anatomical structures. Although large visi…

BenchmarkingSpatial ReasoningText Generation

Comparison of different CNNs for breast tumor classification from ultrasound images

2020-12-28 · Jorge F. Lazo, Sara Moccia, Emanuele Frontoni, Elena De Momi

Breast cancer is one of the deadliest cancer worldwide. Timely detection could reduce mortality rates. In the clinical routine, classifying benign and malignant tumors from ultrasound (US) imaging is a crucial but challe…

General ClassificationTransfer Learning