X-MAN: Explaining multiple sources of anomalies in video
Our objective is to detect anomalies in video while also automatically explaining the reason behind the detector's response. In a practical sense, explainability is crucial for this task as the required response to an anomaly depends on its nature and severity. However, most leading methods (based on deep neural networks) are not interpretable and hide the decision making process in uninterpretable feature representations. In an effort to tackle this problem we make the following contributions: (1) we show how to build interpretable feature representations suitable for detecting anomalies with state of the art performance, (2) we propose an interpretable probabilistic anomaly detector which can describe the reason behind it's response using high level concepts, (3) we are the first to directly consider object interactions for anomaly detection and (4) we propose a new task of explaining anomalies and release a large dataset for evaluating methods on this task. Our method competes well with the state of the art on public datasets while also providing anomaly explanation based on objects and their interactions.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionDecision MakingSimilar Papers 제목 키워드 기반
Anomize: Better Open Vocabulary Video Anomaly Detection
Open Vocabulary Video Anomaly Detection (OVVAD) seeks to detect and classify both base and novel anomalies. However, existing methods face two specific challenges related to novel anomalies. The first challenge is detect…
Anomaly DetectionVideo Anomaly DetectionExplaining Anomalies in Groups with Characterizing Subspace Rules
Anomaly detection has numerous applications and has been studied vastly. We consider a complementary problem that has a much sparser literature: anomaly description. Interpretation of anomalies is crucial for practitione…
Anomaly DetectionDescriptiveTowards Open Set Video Anomaly Detection
Open Set Video Anomaly Detection (OpenVAD) aims to identify abnormal events from video data where both known anomalies and novel ones exist in testing. Unsupervised models learned solely from normal videos are applicable…
Anomaly DetectionMultiple Instance LearningTripletVideo Anomaly DetectionGEE: A Gradient-based Explainable Variational Autoencoder for Network Anomaly Detection
This paper looks into the problem of detecting network anomalies by analyzing NetFlow records. While many previous works have used statistical models and machine learning techniques in a supervised way, such solutions ha…
Anomaly DetectionLearning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection
Weakly supervised video anomaly detection (WSVAD) has predominantly focused on temporal localization, identifying when anomalies occur while largely neglecting their spatial extent within frames. Yet, spatial localizatio…
Multiple Instance LearningVideo Anomaly Detection