paper-with-me

Papers

Multimodal Mathematical Reasoning with Diverse Solving Perspective

2025-07-03 · Wenhao Shi, Zhiqiang Hu, Yi Bin, Guoqing Wang, Xing Xu, Yang Yang, See-Kiong Ng arxiv

Recent progress in large-scale reinforcement learning (RL) has notably enhanced the reasoning capabilities of large language models (LLMs), especially in mathematical domains. However, current multimodal LLMs (MLLMs) for mathematical reasoning often rely on one-to-one image-text pairs and single-solution supervision, overlooking the diversity of valid reasoning perspectives and internal reflections. In this work, we introduce MathV-DP, a novel dataset that captures multiple diverse solution trajectories for each image-question pair, fostering richer reasoning supervision. We further propose Qwen-VL-DP, a model built upon Qwen-VL, fine-tuned with supervised learning and enhanced via group relative policy optimization (GRPO), a rule-based RL approach that integrates correctness discrimination and diversity-aware reward functions. Our method emphasizes learning from varied reasoning perspectives and distinguishing between correct yet distinct solutions. Extensive experiments on the MathVista's minitest and Math-V benchmarks demonstrate that Qwen-VL-DP significantly outperforms prior base MLLMs in both accuracy and generative diversity, highlighting the importance of incorporating diverse perspectives and reflective reasoning in multimodal mathematical reasoning.

📄 PDF Abstract BibTeX arXiv:2507.02804

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningMathematical Reasoning

Similar Papers 제목 키워드 기반

MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval

2026-04-20 · Shaden Alshammari, Kevin Wen, Abrar Zainal, Mark Hamilton 외 arxiv

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a h…

Mathematical Reasoning

Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models

2024-06-25 · Wenhao Shi, Zhiqiang Hu, Yi Bin, Junhua Liu 외

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing lim…

DiversityMathMathematical Problem-SolvingMathematical Reasoning

Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical Reasoning

2024-08-16 · Wenwen Zhuang, Xin Huang, Xiantao Zhang, Jin Zeng

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids g…

MathMathematical ReasoningMultimodal Reasoning

VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark

2026-06-02 · Amirhossein Dabiriaghdam, Shayan Vassef, Mohammadreza Bakhtiari, Yasamin Medghalchi 외 arxiv

Multimodal large language models are increasingly capable of complex reasoning, yet their performance often degrades when they must externalize a problem through a tool and then reason over the tool's output, specificall…

Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

2024-03-06 · Deepanway Ghosal, Vernon Toh Yan Han, Chia Yew Ken, Soujanya Poria

This paper introduces the novel task of multimodal puzzle solving, framed within the context of visual question-answering. We present a new dataset, AlgoPuzzleVQA designed to challenge and evaluate the capabilities of mu…

Multimodal ReasoningQuestion AnsweringVisual Question Answering