paper-with-me

홈 › Papers

Generating Narrated Lecture Videos from Slides with Synchronized Highlights

2025-05-05 · Alexander Holmberg

Turning static slides into engaging video lectures takes considerable time and effort, requiring presenters to record explanations and visually guide their audience through the material. We introduce an end-to-end system designed to automate this process entirely. Given a slide deck, this system synthesizes a video lecture featuring AI-generated narration synchronized precisely with dynamic visual highlights. These highlights automatically draw attention to the specific concept being discussed, much like an effective presenter would. The core technical contribution is a novel highlight alignment module. This module accurately maps spoken phrases to locations on a given slide using diverse strategies (e.g., Levenshtein distance, LLM-based semantic analysis) at selectable granularities (line or word level) and utilizes timestamp-providing Text-to-Speech (TTS) for timing synchronization. We demonstrate the system's effectiveness through a technical evaluation using a manually annotated slide dataset with 1000 samples, finding that LLM-based alignment achieves high location accuracy (F1 > 92%), significantly outperforming simpler methods, especially on complex, math-heavy content. Furthermore, the calculated generation cost averages under $1 per hour of video, offering potential savings of two orders of magnitude compared to conservative estimates of manual production costs. This combination of high accuracy and extremely low cost positions this approach as a practical and scalable tool for transforming static slides into effective, visually-guided video lectures.

📄 PDF Abstract BibTeX arXiv:2505.02966

Code (0)

등록된 구현이 없습니다.

Tasks

Mathtext-to-speechText to Speech

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion

2025-12-02 · Sai Koneru, Fabian Retkowski, Christian Huber, Lukas Hilgert 외 arxiv

The globalization of education and rapid growth of online learning have made localizing educational content a critical challenge. Lecture materials are inherently multimodal, combining spoken audio with visual slides, wh…

Question Answering

PresentAgent: Multimodal Agent for Presentation Video Generation

2025-07-05 · Jingwei Shi, Zeyu Zhang, Biao Wu, Yanjie Liang 외

We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances …

text-to-speechText to SpeechVideo Generation

Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos

2023-01-01 · ICCV 2023 1 · Dong Won Lee, Chaitanya Ahuja, Paul Pu Liang, Sanika Natu 외

Many educational videos use slide presentations, a sequence of visual pages that contain text and figures accompanied by spoken language, which are constructed and presented carefully in order to optimally transfer k…

AttributeRetrievalText Retrieval

Unsupervised Audio-Visual Lecture Segmentation

2022-10-29 · Darshan Singh S, Anchit Gupta, C. V. Jawahar, Makarand Tapaswi

Over the last decade, online lecture videos have become increasingly popular and have experienced a meteoric rise during the pandemic. However, video-language research has primarily focused on instructional videos or mov…

NavigateOptical Character Recognition (OCR)Segmentation

AutoLV: Automatic Lecture Video Generator

2022-09-19 · Wenbin Wang, Yang song, Sanjay Jha

We propose an end-to-end lecture video generation system that can generate realistic and complete lecture videos directly from annotated slides, instructor's reference voice and instructor's reference portrait video. Our…

Speech SynthesisTalking Head GenerationVideo Generation