paper-with-me

Papers

MedGround: Bridging the Evidence Gap in Medical Vision-Language Models with Verified Grounding Data

2026-01-11 · Mengmeng Zhang, Xiaoping Wu, Hao Luo, Fan Wang, Yisheng Lv arxiv

Vision-Language Models (VLMs) can generate convincing clinical narratives, yet frequently struggle to visually ground their statements. We posit this limitation arises from the scarcity of high-quality, large-scale clinical referring-localization pairs. To address this, we introduce MedGround, an automated pipeline that transforms segmentation resources into high-quality medical referring grounding data. Leveraging expert masks as spatial anchors, MedGround precisely derives localization targets, extracts shape and spatial cues, and guides VLMs to synthesize natural, clinically grounded queries that reflect morphology and location. To ensure data rigor, a multi-stage verification system integrates strict formatting checks, geometry- and medical-prior rules, and image-based visual judging to filter out ambiguous or visually unsupported samples. Finally, we present MedGround-35K, a novel multimodal medical dataset. Extensive experiments demonstrate that VLMs trained with MedGround-35K consistently achieve improved referring grounding performance, enhance multi-object semantic disambiguation, and exhibit strong generalization to unseen grounding settings. This work highlights MedGround as a scalable, data-driven approach to anchor medical language to verifiable visual evidence. Dataset and code will be released publicly upon acceptance.

📄 PDF Abstract BibTeX arXiv:2601.06847

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MedGround-R1: Advancing Medical Image Grounding via Spatial-Semantic Rewarded Group Relative Policy Optimization

2025-07-01 · Huihui Xu, Yuanpeng Nie, Hualiang Wang, Ying Chen 외 arxiv

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regio…

Reinforcement Learning

Generalised Medical Phrase Grounding

2025-11-30 · Wenjun Zhang, Shekhar S. Chandra, Aaron Nicolson arxiv

Medical phrase grounding (MPG) maps textual descriptions of radiological findings to corresponding image regions. These grounded reports are easier to interpret, especially for non-experts. Existing MPG systems mostly fo…

Referring ExpressionPhrase Grounding

MedCLM: Learning to Localize and Reason via a CoT-Curriculum in Medical Vision-Language Models

2025-10-06 · Soo Yong Kim, Suin Cho, Vincent-Daniel Yun, Gyeongyeon Hwang arxiv

Bridging clinical diagnostic reasoning with AI remains a central challenge in medical imaging. We introduce MedCLM, an automated pipeline that converts detection datasets into large-scale medical visual question answerin…

Visual Question AnsweringVisual Grounding

Agentic Medical Knowledge Graphs Enhance Medical Question Answering: Bridging the Gap Between LLMs and Evolving Medical Knowledge

2025-02-18 · Mohammad Reza Rezaei, Reza Saadati Fard, Rahul G. Krishnan, Milad Lankarany

Large Language Models (LLMs) have significantly advanced medical question-answering by leveraging extensive clinical data and medical literature. However, the rapid evolution of medical knowledge and the labor-intensive …

Graph GenerationKnowledge GraphsMedical Question AnsweringMedQA+2

LLM-Guided Diagnostic Evidence Alignment for Medical Vision-Language Pretraining under Limited Pairing

2026-02-07 · Huimin Yan, Liang Bai, Xian Yang, Long Chen arxiv

Most existing CLIP-style medical vision--language pretraining methods rely on global or local alignment with substantial paired data. However, global alignment is easily dominated by non-diagnostic information, while loc…

Phrase GroundingText Retrieval