paper-with-me

홈 › Papers

GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AI

2024-11-21 · Tianbin Li, Yanzhou Su, Wei Li, Bin Fu, Zhe Chen, Ziyan Huang, Guoan Wang, Chenglong Ma, Ying Chen, Ming Hu, Yanjun Li, Pengcheng Chen, Xiaowei Hu, Zhongying Deng, Yuanfeng Ji, Jin Ye, Yu Qiao, Junjun He

Despite significant advancements in general AI, its effectiveness in the medical domain is limited by the lack of specialized medical knowledge. To address this, we formulate GMAI-VL-5.5M, a multimodal medical dataset created by converting hundreds of specialized medical datasets with various annotations into high-quality image-text pairs. This dataset offers comprehensive task coverage, diverse modalities, and rich image-text data. Building upon this dataset, we develop GMAI-VL, a general medical vision-language model, with a three-stage training strategy that enhances the integration of visual and textual information. This approach significantly improves the model's ability to process multimodal data, supporting accurate diagnoses and clinical decision-making. Experiments show that GMAI-VL achieves state-of-the-art performance across various multimodal medical tasks, including visual question answering and medical image diagnosis.

📄 PDF Abstract BibTeX arXiv:2411.14522

Code (1)

uni-medical/gmai-vl 공식 구현 pytorch

Tasks

Decision MakingLanguage ModelingLanguage ModellingQuestion AnsweringVisual Question Answering

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Generalized Mask-aware IoU for Anchor Assignment for Real-time Instance Segmentation

2023-12-28 · Barış Can Çam, Kemal Öksüz, Fehmi Kahraman, Zeynep Sonat Baltaci 외

This paper introduces Generalized Mask-aware Intersection-over-Union (GmaIoU) as a new measure for positive-negative assignment of anchor boxes during training of instance segmentation methods. Unlike conventional IoU me…

Instance SegmentationReal-time Instance SegmentationSegmentationSemantic Segmentation

GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI

2024-08-06 · Pengcheng Chen, Jin Ye, Guoan Wang, Yanjun Li 외

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Gmail Smart Compose: Real-Time Assisted Writing

2019-05-17 · Mia Xu Chen, Benjamin N Lee, Gagan Bansal, Yuan Cao 외

In this paper, we present Smart Compose, a novel system for generating interactive, real-time suggestions in Gmail that assists users in writing mails by reducing repetitive typing. In the design and deployment of such a…

Language ModelingLanguage ModellingModel Selection

GMAIR: Unsupervised Object Detection Based on Spatial Attention and Gaussian Mixture

2021-06-03 · Weijin Zhu, Yao Shen, Linfeng Yu, Lizeth Patricia Aguirre Sanchez

Recent studies on unsupervised object detection based on spatial attention have achieved promising results. Models, such as AIR and SPAIR, output "what" and "where" latent variables that represent the attributes and loca…

ClusteringObjectobject-detectionObject Detection+2

GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning

2025-04-02 · Yanzhou Su, Tianbin Li, Jiyao Liu, Chenglong Ma 외

Recent advances in general medical AI have made significant strides, but existing models often lack the reasoning capabilities needed for complex medical decision-making. This paper presents GMAI-VL-R1, a multimodal medi…

Decision MakingDiagnosticMemorizationQuestion Answering+2