paper-with-me

홈 › Papers

TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding

2025-02-26 · Max Ku, Thomas Chong, Jonathan Leung, Krish Shah, Alvin Yu, Wenhu Chen

Understanding domain-specific theorems often requires more than just text-based reasoning; effective communication through structured visual explanations is crucial for deeper comprehension. While large language models (LLMs) demonstrate strong performance in text-based theorem reasoning, their ability to generate coherent and pedagogically meaningful visual explanations remains an open challenge. In this work, we introduce TheoremExplainAgent, an agentic approach for generating long-form theorem explanation videos (over 5 minutes) using Manim animations. To systematically evaluate multimodal theorem explanations, we propose TheoremExplainBench, a benchmark covering 240 theorems across multiple STEM disciplines, along with 5 automated evaluation metrics. Our results reveal that agentic planning is essential for generating detailed long-form videos, and the o3-mini agent achieves a success rate of 93.8% and an overall score of 0.77. However, our quantitative and qualitative studies show that most of the videos produced exhibit minor issues with visual element layout. Furthermore, multimodal explanations expose deeper reasoning flaws that text-based explanations fail to reveal, highlighting the importance of multimodal explanations.

📄 PDF Abstract BibTeX arXiv:2502.19400

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

PhysicsSolutionAgent: Towards Multimodal Explanations for Numerical Physics Problem Solving

2026-01-19 · Aditya Thole, Anmol Agrawal, Arnav Ramamoorthy, Dhruv Kumar arxiv

Explaining numerical physics problems often requires more than text-based solutions; clear visual reasoning can substantially improve conceptual understanding. While large language models (LLMs) demonstrate strong perfor…

Multimodal ReasoningVisual ReasoningCode Generation

Automating Skill Acquisition through Large-Scale Mining of Open-Source Agentic Repositories: A Framework for Multi-Agent Procedural Knowledge Extraction

2026-03-12 · Shuzhen Bi, Mengsong Wu, Hao Hao, Keqian Li 외 arxiv

The transition from monolithic large language models (LLMs) to modular, skill-equipped agents represents a fundamental architectural shift in artificial intelligence deployment. While general-purpose models demonstrate r…

StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models

2024-08-31 · Yuxiang Guo, Faizan Siddiqui, Yang Zhao, Rama Chellappa 외

Predicting and reasoning how a video would make a human feel is crucial for developing socially intelligent systems. Although Multimodal Large Language Models (MLLMs) have shown impressive video understanding capabilitie…

Video Understanding

Can Language Models Laugh at YouTube Short-form Videos?

2023-10-22 · Dayoon Ko, Sangho Lee, Gunhee Kim

As short-form funny videos on social networks are gaining popularity, it becomes demanding for AI models to understand them for better communication with humans. Unfortunately, previous video humor datasets target specif…

Form

Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos

2023-01-01 · ICCV 2023 1 · Dong Won Lee, Chaitanya Ahuja, Paul Pu Liang, Sanika Natu 외

Many educational videos use slide presentations, a sequence of visual pages that contain text and figures accompanied by spoken language, which are constructed and presented carefully in order to optimally transfer k…

AttributeRetrievalText Retrieval