paper-with-me

Papers

Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision

2026-06-30 · Xianda Zheng, Huan Gao, Meng-Fen Chiang, Michael Witbrock, Kaiqi Zhao, Shangyang Li arxiv

Despite recent progress, the reasoning capabilities of large multimodal language models (MLLMs) remain fundamentally constrained by static supervision, where fixed prompts, rules, or reward models provide non-adaptive guidance throughout training. Such static signals are often sufficient to enforce output formats, but fail to shape the underlying reasoning process, leading to brittle generalization and performance saturation in complex decision-making tasks. We propose Evo-PI, a principle-centric learning framework that treats reasoning principles as explicit, language-based supervision signals that can be generated, evaluated, and iteratively evolved. Instead of relying on fixed rewards, Evo-PI enables a co-evolutionary loop in which principles guide model reasoning, while model behaviors in turn refine the principles that supervise them. This dynamic alignment mechanism allows supervision to progressively adapt to the model's reasoning deficiencies. We instantiate Evo-PI in medical visual question answering as a high-stakes testbed requiring structured visual-textual reasoning. Across eight benchmarks and multiple model backbones, Evo-PI consistently improves reasoning accuracy, achieving gains of up to 24.6%. Our results suggest that evolving principle-guided supervision offers a scalable and general paradigm for training expert-aligned reasoning in MLLMs. Code is available at https://github.com/zhengxianda/Evo_PI.

📄 PDF Abstract BibTeX arXiv:2606.31800

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Question Answering

Similar Papers 제목 키워드 기반

Toward Contemplative LLM: A Modular Framework for Evaluating and Enhancing LLM Alignment in Mental Health

2026-07-12 · Asher Sprigler, Yang-Yang Feng, Iftach Amir, Jonathan E. Bogard 외 arxiv

Contemplative traditions have long guided ethical behavior and prosocial interaction, and recent work suggests that contemplative principles (e.g., mindfulness, compassion, non-dual reasoning) may offer a promising parad…

ClinAlign: Scaling Healthcare Alignment from Clinician Preference

2026-02-10 · Shiwei Lyu, Xidong Wang, Lei Liu, Hao Zhu 외 arxiv

Although large language models (LLMs) demonstrate expert-level medical knowledge, aligning their open-ended outputs with fine-grained clinician preferences remains challenging. Existing methods often rely on coarse objec…

From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG

2026-02-06 · Wenhao Wu, Zhentao Tang, Yafu Li, Shixiong Kai 외 arxiv

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-A…

WebArbiter: A Principle-Guided Reasoning Process Reward Model for Web Agents

2026-01-29 · Yao Zhang, Shijie Tang, Zeyu Li, Zhen Han 외 arxiv

Web agents hold great potential for automating complex computer tasks, yet their interactions involve long-horizon, sequential decision-making with irreversible actions. In such settings, outcome-based supervision is spa…

Reinforcement LearningText Generation

MedEinst: Benchmarking the Einstellung Effect in Medical LLMs through Counterfactual Differential Diagnosis

2026-01-10 · Wenting Chen, Zhongrui Zhu, Guolin Huang, Wenxuan Wang arxiv

Despite achieving high accuracy on medical benchmarks, LLMs exhibit the Einstellung Effect in clinical diagnosis--relying on statistical shortcuts rather than patient-specific evidence, causing misdiagnosis in atypical c…

Causal Inference