Beat-Event Detection in Action Movie Franchises
While important advances were recently made towards temporally localizing and recognizing specific human actions or activities in videos, efficient detection and classification of long video chunks belonging to semantically defined categories such as "pursuit" or "romance" remains challenging.We introduce a new dataset, Action Movie Franchises, consisting of a collection of Hollywood action movie franchises. We define 11 non-exclusive semantic categories - called beat-categories - that are broad enough to cover most of the movie footage. The corresponding beat-events are annotated as groups of video shots, possibly overlapping.We propose an approach for localizing beat-events based on classifying shots into beat-categories and learning the temporal constraints between shots. We show that temporal constraints significantly improve the classification performance. We set up an evaluation protocol for beat-event localization as well as for shot classification, depending on whether movies from the same franchise are present or not in the training data.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationEvent DetectionGeneral ClassificationSimilar Papers 제목 키워드 기반
GenéLive! Generating Rhythm Actions in Love Live!
This article presents our generative model for rhythm action games together with applications in business operations. Rhythm action games are video games in which the player is challenged to issue commands at the right t…
RhythmA Real-Time Automated Point-Process Method for the Detection and Correction of Erroneous and Ectopic Heartbeats
The presence of recurring arrhythmic events (also known as cardiac dysrhythmia or irregular heartbeats), as well as erroneous beat detection due to low signal quality, significantly affects estimation of both time and fr…
Heartbeat ClassificationHeart Rate VariabilityRhythmSpecificityA dataset for Audio-Visual Sound Event Detection in Movies
Audio event detection is a widely studied audio processing task, with applications ranging from self-driving cars to healthcare. In-the-wild datasets such as Audioset have propelled research in this field. However, many …
Event DetectionSelf-Driving CarsSound ClassificationSound Event DetectionMovie Genre Classification by Language Augmentation and Shot Sampling
Video-based movie genre classification has garnered considerable attention due to its various applications in recommendation systems. Prior work has typically addressed this task by adapting models from traditional video…
Action RecognitionBoundary DetectionClassificationEvent Detection+4Neural Event Extraction from Movies Description
We present a novel approach for event extraction and abstraction from movie descriptions. Our event frame consists of {``}who{''}, {``}did what{''} {``}to whom{''}, {``}where{''}, and {``}when{''}. We formulate our probl…
Event ExtractionMachine TranslationQuestion AnsweringStory Completion+1