Spatio-Temporal Relation Learning for Video Anomaly Detection
Anomaly identification is highly dependent on the relationship between the object and the scene, as different/same object actions in same/different scenes may lead to various degrees of normality and anomaly. Therefore, object-scene relation actually plays a crucial role in anomaly detection but is inadequately explored in previous works. In this paper, we propose a Spatial-Temporal Relation Learning (STRL) framework to tackle the video anomaly detection task. First, considering dynamic characteristics of the objects as well as scene areas, we construct a Spatio-Temporal Auto-Encoder (STAE) to jointly exploit spatial and temporal evolution patterns for representation learning. For better pattern extraction, two decoding branches are designed in the STAE module, i.e. an appearance branch capturing spatial cues by directly predicting the next frame, and a motion branch focusing on modeling the dynamics via optical flow prediction. Then, to well concretize the object-scene relation, a Relation Learning (RL) module is devised to analyze and summarize the normal relations by introducing the Knowledge Graph Embedding methodology. Specifically in this process, the plausibility of object-scene relation is measured by jointly modeling object/scene features and optimizable object-scene relation maps. Extensive experiments are conducted on three public datasets, and the superior performance over the state-of-the-art methods demonstrates the effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionGraph EmbeddingKnowledge Graph EmbeddingObjectOptical Flow EstimationRelationRepresentation LearningVideo Anomaly DetectionSimilar Papers 제목 키워드 기반
Spatio-Temporal-based Context Fusion for Video Anomaly Detection
Video anomaly detection aims to discover abnormal events in videos, and the principal objects are target objects such as people and vehicles. Each target in the video data has rich spatio-temporal context information. Mo…
Anomaly DetectionOptical Flow EstimationVideo Anomaly DetectionAssistPDA: An Online Video Surveillance Assistant for Video Anomaly Prediction, Detection, and Analysis
The rapid advancements in large language models (LLMs) have spurred growing interest in LLM-based video anomaly detection (VAD). However, existing approaches predominantly focus on video-level anomaly question answering …
Anomaly DetectionAnomaly ForecastingQuestion AnsweringVideo Anomaly DetectionAnomaly Detection in Video Sequences: A Benchmark and Computational Model
Anomaly detection has attracted considerable search attention. However, existing anomaly detection databases encounter two major problems. Firstly, they are limited in scale. Secondly, training sets contain only video-le…
Anomaly DetectionWeakly-Supervised Spatiotemporal Anomaly Detection
In this paper, we explore a weakly supervised method for anomaly detection. Since annotating videos is time-consuming, we only look at weak video-level labels during training. This means that given a video, we know that …
Anomaly DetectionWeakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Video
In this paper, we introduce a novel task, referred to as Weakly-Supervised Spatio-Temporal Anomaly Detection (WSSTAD) in surveillance video. Specifically, given an untrimmed video, WSSTAD aims to localize a spatio-tempor…
Anomaly Detection