BreastScreening: On the Use of Multi-Modality in Medical Imaging Diagnosis
This paper describes the field research, design and comparative deployment of a multimodal medical imaging user interface for breast screening. The main contributions described here are threefold: 1) The design of an advanced visual interface for multimodal diagnosis of breast cancer (BreastScreening); 2) Insights from the field comparison of single vs multimodality screening of breast cancer diagnosis with 31 clinicians and 566 images, and 3) The visualization of the two main types of breast lesions in the following image modalities: (i) MammoGraphy (MG) in both Craniocaudal (CC) and Mediolateral oblique (MLO) views; (ii) UltraSound (US); and (iii) Magnetic Resonance Imaging (MRI). We summarize our work with recommendations from the radiologists for guiding the future design of medical imaging interfaces.
Code (8)
Tasks
3D Medical Imaging SegmentationAutomatic Machine Learning Model SelectionBreast Cancer DetectionBreast Mass Segmentation In Whole MammogramsBreast Tumour ClassificationInterpretable Machine LearningMathematical ProofsMedical DiagnosisMedical Image RetrievalProbabilistic Deep LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Holistic Evaluation of GPT-4V for Biomedical Imaging
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer visio…
AnatomyDiagnosticImage CaptioningLesion DetectionDeep Multimodal Guidance for Medical Image Classification
Medical imaging is a cornerstone of therapy and diagnosis in modern medicine. However, the choice of imaging modality for a particular theranostic task typically involves trade-offs between the feasibility of using a par…
Brain Tumor ClassificationClassificationDiagnosticimage-classification+4Graph Convolutional Networks for Multi-modality Medical Imaging: Methods, Architectures, and Clinical Applications
Image-based characterization and disease understanding involve integrative analysis of morphological, spatial, and topological information across biological scales. The development of graph convolutional networks (GCNs) …
Medical Image AnalysisAliFuse: Aligning and Fusing Multi-modal Medical Data for Computer-Aided Diagnosis
Medical data collected for diagnostic decisions are typically multimodal, providing comprehensive information on a subject. While computer-aided diagnosis systems can benefit from multimodal inputs, effectively fusing su…
Contrastive LearningDiagnosticProbMed: A Probabilistic Framework for Medical Multimodal Binding
Medical decision-making requires integrating diverse medical information, from imaging to clinical narratives. These medical modalities are often acquired in a many-to-many manner. However, current medical vision-languag…
Contrastive Learning