SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions
Detecting suspicious activities in surveillance videos is a longstanding problem in real-time surveillance that leads to difficulties in detecting crimes. Hence, we propose a novel approach for detecting and summarizing suspicious activities in surveillance videos. We have also created ground truth summaries for the UCF-Crime video dataset. We modify a pre-existing approach for this task by leveraging the Human-Object Interaction (HOI) model for the Visual features in the Bi-Modal Transformer. Further, we validate our approach against the existing state-of-the-art algorithms for the Dense Video Captioning task for the ActivityNet Captions dataset. We observe that this formulation for Dense Captioning performs significantly better than other discussed BMT-based approaches for BLEU@1, BLEU@2, BLEU@3, BLEU@4, and METEOR. We further perform a comparative analysis of the dataset and the model to report the findings based on different NMS thresholds (searched using Genetic Algorithms). Here, our formulation outperforms all the models for BLEU@1, BLEU@2, BLEU@3, and most models for BLEU@4 and METEOR falling short of only ADV-INF Global by 25% and 0.5%, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Dense CaptioningDense Video CaptioningHuman-Object Interaction DetectionVideo CaptioningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Critical Analysis on Machine Learning Techniques for Video-based Human Activity Recognition of Surveillance Systems: A Review
Upsurging abnormal activities in crowded locations such as airports, train stations, bus stops, shopping malls, etc., urges the necessity for an intelligent surveillance system. An intelligent surveillance system can dif…
Activity RecognitionGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1Real-World Community-in-the-Loop Smart Video Surveillance -- A Case Study at a Community College
Smart Video surveillance systems have become important recently for ensuring public safety and security, especially in smart cities. However, applying real-time artificial intelligence technologies combined with low-late…
Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillance
Maritime surveillance is vital to mitigate illegal activities such as drug smuggling, illegal fishing, and human trafficking. Vision-based maritime surveillance is challenging mainly due to visibility issues at night, wh…
Action DetectionActivity DetectionObject TrackingA Video-based Detector for Suspicious Activity in Examination with OpenPose
Examinations are a crucial part of the learning process, and academic institutions invest significant resources into maintaining their integrity by preventing cheating from students or facilitators. However, cheating has…
FairnessDetecting Suspicious Commenter Mob Behaviors on YouTube Using Graph2Vec
YouTube, a widely popular online platform, has transformed the dynamics of con-tent consumption and interaction for users worldwide. With its extensive range of content crea-tors and viewers, YouTube serves as a hub for …