paper-with-me

Papers

Code2Video: A Code-centric Paradigm for Educational Video Generation

2025-10-01 · Yanzhe Chen, Kevin Qinghong Lin, Mike Zheng Shou arxiv

While recent generative models advance pixel-space video synthesis, they remain limited in producing professional educational videos, which demand disciplinary knowledge, precise visual structures, and coherent transitions, limiting their applicability in educational scenarios. Intuitively, such requirements are better addressed through the manipulation of a renderable environment, which can be explicitly controlled via logical commands (e.g., code). In this work, we propose Code2Video, a code-centric agent framework for generating educational videos via executable Python code. The framework comprises three collaborative agents: (i) Planner, which structures lecture content into temporally coherent flows and prepares corresponding visual assets; (ii) Coder, which converts structured instructions into executable Python codes while incorporating scope-guided auto-fix to enhance efficiency; and (iii) Critic, which leverages vision-language models (VLM) with visual anchor prompts to refine spatial layout and ensure clarity. To support systematic evaluation, we build MMMC, a benchmark of professionally produced, discipline-specific educational videos. We evaluate MMMC across diverse dimensions, including VLM-as-a-Judge aesthetic scores, code efficiency, and particularly, TeachQuiz, a novel end-to-end metric that quantifies how well a VLM, after unlearning, can recover knowledge by watching the generated videos. Our results demonstrate the potential of Code2Video as a scalable, interpretable, and controllable approach, achieving 40% improvement over direct code generation and producing videos comparable to human-crafted tutorials. The code and datasets are available at https://github.com/showlab/Code2Video.

📄 PDF Abstract BibTeX arXiv:2510.01174

Code (0)

등록된 구현이 없습니다.

Tasks

Video GenerationCode Generation

Similar Papers 제목 키워드 기반

VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding

2025-01-22 · Boqiang Zhang, Kehan Li, Zesen Cheng, Zhiqiang Hu 외

In this paper, we propose VideoLLaMA3, a more advanced multimodal foundation model for image and video understanding. The core design philosophy of VideoLLaMA3 is vision-centric. The meaning of "vision-centric" is two-fo…

PhilosophyVideo Question AnsweringVideo Understanding

EDU-MATRIX: A Society-Centric Generative Cognitive Digital Twin Architecture for Secondary Education

2026-02-21 · Wenjing Zhai, Jianbin Zhang, Tao Liu arxiv

Existing multi-agent simulations often suffer from the "Agent-Centric Paradox": rules are hard-coded into individual agents, making complex social dynamics rigid and difficult to align with educational values. This paper…

Class Prototypes Based Contrastive Learning for Classifying Multi-Label and Fine-Grained Educational Videos

2023-01-01 · CVPR 2023 1 · Rohit Gupta, Anirban Roy, Claire Christensen, Sujeong Kim 외

The recent growth in the consumption of online media by children during early childhood necessitates data-driven tools enabling educators to filter out appropriate educational content for young learners. This paper p…

Contrastive LearningMathVideo Classification

Class Prototypes based Contrastive Learning for Classifying Multi-Label and Fine-Grained Educational Videos

2025-10-13 · Rohit Gupta, Anirban Roy, Claire Christensen, Sujeong Kim 외 arxiv

The recent growth in the consumption of online media by children during early childhood necessitates data-driven tools enabling educators to filter out appropriate educational content for young learners. This paper prese…

Contrastive Learning

RynnEC: Bringing MLLMs into Embodied World

2025-08-19 · Ronghao Dang, Yuqian Yuan, Yunxuan Mao, Kehan Li 외 arxiv

We introduce RynnEC, a video multimodal large language model designed for embodied cognition. Built upon a general-purpose vision-language foundation model, RynnEC incorporates a region encoder and a mask decoder, enabli…

Object SegmentationSpatial Reasoning