paper-with-me

홈 › Papers

Overcoming Data Limitation in Medical Visual Question Answering

2019-09-26 · Binh D. Nguyen, Thanh-Toan Do, Binh X. Nguyen, Tuong Do, Erman Tjiputra, Quang D. Tran

Traditional approaches for Visual Question Answering (VQA) require large amount of labeled data for training. Unfortunately, such large scale data is usually not available for medical domain. In this paper, we propose a novel medical VQA framework that overcomes the labeled data limitation. The proposed framework explores the use of the unsupervised Denoising Auto-Encoder (DAE) and the supervised Meta-Learning. The advantage of DAE is to leverage the large amount of unlabeled images while the advantage of Meta-Learning is to learn meta-weights that quickly adapt to VQA problem with limited labeled data. By leveraging the advantages of these techniques, it allows the proposed framework to be efficiently trained using a small labeled training set. The experimental results show that our proposed method significantly outperforms the state-of-the-art medical VQA.

📄 PDF Abstract BibTeX arXiv:1909.11867

Code (2)

aioz-ai/MICCAI19-MedVQA 공식 구현 pytorch
sarahesl/pubmedclip pytorch

Tasks

DenoisingMedical Visual Question AnsweringMeta-LearningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Similar Papers 제목 키워드 기반

Consistency-preserving Visual Question Answering in Medical Imaging

2022-06-27 · Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential adva…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering

2023-12-13 · Xiaojie Hong, Zixin Song, Liangzhi Li, Xiaoli Wang 외

Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly …

Medical Visual Question AnsweringQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

`Just because you are right, doesn't mean I am wrong': Overcoming a bottleneck in development and evaluation of Open-Ended VQA tasks

2021-04-01 · EACL 2021 2 · Man Luo, Shailaja Keyur Sampat, Riley Tallman, Yankai Zeng 외

GQA (CITATION) is a dataset for real-world visual reasoning and compositional question answering. We found that many answers predicted by the best vision-language models on the GQA dataset do not match the ground-truth a…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Visual Reasoning

'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering (VQA) Tasks

2021-03-28 · Man Luo, Shailaja Keyur Sampat, Riley Tallman, Yankai Zeng 외

GQA~\citep{hudson2019gqa} is a dataset for real-world visual reasoning and compositional question answering. We found that many answers predicted by the best vision-language models on the GQA dataset do not match the gro…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Visual Reasoning

Knowledge Hierarchy Guided Biological-Medical Dataset Distillation for Domain LLM Training

2025-01-25 · Xunxin Cai, Chengrui Wang, Qingqing Long, Yuanchun Zhou 외

The rapid advancement of large language models (LLMs) in biological-medical applications has highlighted a gap between their potential and the limited scale and often low quality of available open-source annotated textua…

Dataset DistillationQuestion Answering