paper-with-me

홈 › Papers

MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution

2026-04-29 · Chunzheng Zhu, Jiaqi Zeng, Junyu Jiang, Jianxin Lin, Yijun Wang arxiv

High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs caused by discrete tokenization, leading to quantization loss, long-range information dissipation, and missing case-adaptive expertise. To bridge this gap, we propose ours, a framework for latent diagnostic memory evolution that simulates the experiential invocation of clinicians by dynamically synthesizing implicit diagnostic memories within the model's hidden stream. Specifically, it begins with a Meta Query for Prior Memorization mechanism, where learnable probes retrieve structured priors from an anatomical prior encoder to generate condensed implicit memories. To ensure clinical fidelity, we introduce Causal Counterfactual Refinement (CCR), which leverages reinforcement learning and counterfactual rewards derived from region-level feature masking to quantify the causal contribution of each memory, thereby pruning redundancies and aligning latent representations with diagnostic logic. This evolutionary process culminates in Intrinsic Memory Transition (IMT), a privileged-autonomous dual-branch paradigm that internalizes teacher-branch diagnostic patterns into the student-branch via full-vocabulary divergence alignment. Comprehensive empirical evaluations across multiple datasets demonstrate that ours, by transferring external expertise into endogenous parameters, significantly outperforms existing state-of-the-art methods, particularly chain-of-thought paradigms, in diagnostic accuracy. The code is available at https://github.com/zhcz328/MedSynapse-V.

📄 PDF Abstract BibTeX arXiv:2604.26283

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningMedical Diagnosis

Similar Papers 제목 키워드 기반

Bridging Visual Perception with Contextual Semantics for Understanding Robot Manipulation Tasks

2019-09-16 · Chen Jiang, Martin Jagersand

Understanding manipulation scenarios allows intelligent robots to plan for appropriate actions to complete a manipulation task successfully. It is essential for intelligent robots to semantically interpret manipulation k…

AttributeCommon Sense ReasoningKnowledge GraphsLanguage Modeling+2

Unveiling and Bridging the Functional Perception Gap in MLLMs: Atomic Visual Alignment and Hierarchical Evaluation via PET-Bench

2026-01-06 · Zanting Ye, Xiaolong Niu, Xuanbin Wu, Xu Han 외 arxiv

While Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in tasks such as abnormality detection and report generation for anatomical modalities, their capability in functional imaging remai…

CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solving

2026-01-05 · Shuhang Chen, Yunqiu Xu, Junjie Xie, Aojun Lu 외 arxiv

Despite significant progress, multimodal large language models continue to struggle with visual mathematical problem solving. Some recent works recognize that visual perception is a bottleneck in visual mathematical reas…

Information ExtractionMathematical Reasoning

CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding

2025-09-27 · Xi Zhang, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho arxiv

Multimodal large language models (MLLMs) have recently achieved remarkable progress in radiology by integrating visual perception with natural language understanding. However, they often generate clinically unsupported d…

Natural Language Understanding

VLM-FO1: Bridging the Gap Between High-Level Reasoning and Fine-Grained Perception in VLMs

2025-09-30 · Peng Liu, Haozhan Shen, Chunxin Fang, Zhicheng Sun 외 arxiv

Vision-Language Models (VLMs) excel at high-level scene understanding but falter on fine-grained perception tasks requiring precise localization. This failure stems from a fundamental mismatch, as generating exact numeri…

Scene UnderstandingVisual Grounding