Towards Data-Driven Automatic Video Editing
Automatic video editing involving at least the steps of selecting the most valuable footage from points of view of visual quality and the importance of action filmed; and cutting the footage into a brief and coherent visual story that would be interesting to watch is implemented in a purely data-driven manner. Visual semantic and aesthetic features are extracted by the ImageNet-trained convolutional neural network, and the editing controller is trained by an imitation learning algorithm. As a result, at test time the controller shows the signs of observing basic cinematography editing rules learned from the corpus of motion pictures masterpieces.
Code (0)
등록된 구현이 없습니다.
Tasks
Imitation LearningVideo EditingSimilar Papers 제목 키워드 기반
A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Model
In this era of videos, automatic video editing techniques attract more and more attention from industry and academia since they can reduce workloads and lower the requirements for human editors. Existing automatic editin…
Language ModelingLanguage ModellingReinforcement Learning (RL)Video EditingRefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing
Recent advances in video editing have been largely driven by large-scale instruction-based datasets. However, existing datasets still suffer from two critical limitations. First, target videos are commonly produced by au…
Image EditingTDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMs
Text-driven video editing is rapidly advancing, yet its rigorous evaluation remains challenging due to the absence of dedicated video quality assessment (VQA) models capable of discerning the nuances of editing quality. …
BenchmarkingLarge Language ModelVideo EditingVideo Quality Assessment+1MEDit-Bench: A Dataset for Evaluating Message-Driven Narrative Video Editing
Video editing is fundamentally message-driven: even from the same source footage, the selected shots change depending on the narrative the editor wishes to convey. Benchmarks for a closely related task, video summarizati…
Video SummarizationVE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
Text-driven video editing has recently experienced rapid development. Despite this, evaluating edited videos remains a considerable challenge. Current metrics tend to fail to align with human perceptions, and effective q…
Video AlignmentVideo EditingVideo Quality AssessmentVisual Question Answering (VQA)