paper-with-me

홈 › Papers

SliTraNet: Automatic Detection of Slide Transitions in Lecture Videos using Convolutional Neural Networks

2022-02-07 · Aline Sindel, Abner Hernandez, Seung Hee Yang, Vincent Christlein, Andreas Maier

With the increasing number of online learning material in the web, search for specific content in lecture videos can be time consuming. Therefore, automatic slide extraction from the lecture videos can be helpful to give a brief overview of the main content and to support the students in their studies. For this task, we propose a deep learning method to detect slide transitions in lectures videos. We first process each frame of the video by a heuristic-based approach using a 2-D convolutional neural network to predict transition candidates. Then, we increase the complexity by employing two 3-D convolutional neural networks to refine the transition candidates. Evaluation results demonstrate the effectiveness of our method in finding slide transitions.

📄 PDF Abstract BibTeX arXiv:2202.03540

Code (1)

asindel/SliTraNet 공식 구현 pytorch

Similar Papers 제목 키워드 기반

MaViLS, a Benchmark Dataset for Video-to-Slide Alignment, Assessing Baseline Accuracy with a Multimodal Alignment Algorithm Leveraging Speech, OCR, and Visual Features

2024-09-25 · Katharina Anderer, Andreas Reich, Matthias Wölfel

This paper presents a benchmark dataset for aligning lecture videos with corresponding slides and introduces a novel multimodal algorithm leveraging features from speech, text, and images. It achieves an average accuracy…

Optical Character RecognitionOptical Character Recognition (OCR)

Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordination

2024-09-11 · Daniel Zhang-li, Zheyuan Zhang, Jifan Yu, Joy Lim Jia Yin 외

The vast pre-existing slides serve as rich and important materials to carry lecture knowledge. However, effectively leveraging lecture slides to serve students is difficult due to the multi-modal nature of slide content …

Language ModelingLanguage Modelling

Developing Corpus of Lecture Utterances Aligned to Slide Components

2016-12-01 · WS 2016 12 · Ryo Minamiguchi, Masatoshi Tsuchiya

The approach which formulates the automatic text summarization as a maximum coverage problem with knapsack constraint over a set of textual units and a set of weighted conceptual units is promising. However, it is quite …

Text Summarization

Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides

2022-08-17 · Dong Won Lee, Chaitanya Ahuja, Paul Pu Liang, Sanika Natu 외

Lecture slide presentations, a sequence of pages that contain text and figures accompanied by speech, are constructed and presented carefully in order to optimally transfer knowledge to students. Previous studies in mult…

Attribute

Generating Narrated Lecture Videos from Slides with Synchronized Highlights

2025-05-05 · Alexander Holmberg

Turning static slides into engaging video lectures takes considerable time and effort, requiring presenters to record explanations and visually guide their audience through the material. We introduce an end-to-end system…

Mathtext-to-speechText to Speech