What is usual in unusual videos? Trajectory snippet histograms for discovering unusualness
Unusual events are important as being possible indicators of undesired consequences. Moreover, unusualness in everyday life activities may also be amusing to watch as proven by the popularity of such videos shared in social media. Discovery of unusual events in videos is generally attacked as a problem of finding usual patterns, and then separating the ones that do not resemble to those. In this study, we address the problem from the other side, and try to answer what type of patterns are shared among unusual videos that make them resemble to each other regardless of the ongoing event. With this challenging problem at hand, we propose a novel descriptor to encode the rapid motions in videos utilizing densely extracted trajectories. The proposed descriptor, which is referred to as trajectory snipped histograms, is used to distinguish unusual videos from usual videos, and further exploited to discover snapshots in which unusualness happen. Experiments on domain specific people falling videos and unrestricted funny videos show the effectiveness of our method in capturing unusualness.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
UAL-Bench: The First Comprehensive Unusual Activity Localization Benchmark
Localizing unusual activities, such as human errors or surveillance incidents, in videos holds practical significance. However, current video understanding models struggle with localizing these unusual events likely beca…
Unusual Activity LocalizationVideo UnderstandingWhat Can We Learn from Harry Potter? An Exploratory Study of Visual Representation Learning from Atypical Videos
Humans usually show exceptional generalisation and discovery ability in the open world, when being shown uncommon new concepts. Whereas most existing studies in the literature focus on common typical data from closed set…
Zero-Shot Action RecognitionRepresentation LearningWhat's Wrong With That Object? Identifying Images of Unusual Objects by Modelling the Detection Score Distribution
This paper studies the challenging problem of identifying unusual instances of known objects in images within an "open world" setting. That is, we aim to find objects that are members of a known class, but which are not …
Gaussian ProcessesObjectobject-detectionObject DetectionSpace, Time, and Interaction: A Taxonomy of Corner Cases in Trajectory Datasets for Automated Driving
Trajectory data analysis is an essential component for highly automated driving. Complex models developed with these data predict other road users' movement and behavior patterns. Based on these predictions - and additio…
Planning with Diffusion for Flexible Behavior Synthesis
Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While co…
Decision MakingDenoisingImage InpaintingModel-based Reinforcement Learning