paper-with-me

홈 › Papers

SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions

2022-07-24 · Ansh Mittal, Shuvam Ghosal, Rishibha Bansal

Detecting suspicious activities in surveillance videos is a longstanding problem in real-time surveillance that leads to difficulties in detecting crimes. Hence, we propose a novel approach for detecting and summarizing suspicious activities in surveillance videos. We have also created ground truth summaries for the UCF-Crime video dataset. We modify a pre-existing approach for this task by leveraging the Human-Object Interaction (HOI) model for the Visual features in the Bi-Modal Transformer. Further, we validate our approach against the existing state-of-the-art algorithms for the Dense Video Captioning task for the ActivityNet Captions dataset. We observe that this formulation for Dense Captioning performs significantly better than other discussed BMT-based approaches for BLEU@1, BLEU@2, BLEU@3, BLEU@4, and METEOR. We further perform a comparative analysis of the dataset and the model to report the findings based on different NMS thresholds (searched using Genetic Algorithms). Here, our formulation outperforms all the models for BLEU@1, BLEU@2, BLEU@3, and most models for BLEU@4 and METEOR falling short of only ADV-INF Global by 25% and 0.5%, respectively.

📄 PDF Abstract BibTeX arXiv:2207.11838

Code (0)

등록된 구현이 없습니다.

Tasks

Dense CaptioningDense Video CaptioningHuman-Object Interaction DetectionVideo Captioning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

A Critical Analysis on Machine Learning Techniques for Video-based Human Activity Recognition of Surveillance Systems: A Review

2024-09-01 · Shahriar Jahan, Roknuzzaman, Md Robiul Islam

Upsurging abnormal activities in crowded locations such as airports, train stations, bus stops, shopping malls, etc., urges the necessity for an intelligent surveillance system. An intelligent surveillance system can dif…

Activity RecognitionGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1

Real-World Community-in-the-Loop Smart Video Surveillance -- A Case Study at a Community College

2023-03-22 · Shanle Yao, Babak Rahimi Ardabili, Armin Danesh Pazho, Ghazal Alinezhad Noghre 외

Smart Video surveillance systems have become important recently for ensuring public safety and security, especially in smart cities. However, applying real-time artificial intelligence technologies combined with low-late…

Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillance

2024-06-12 · Yasod Ginige, Ransika Gunasekara, Darsha Hewavitharana, Manjula Ariyarathne 외

Maritime surveillance is vital to mitigate illegal activities such as drug smuggling, illegal fishing, and human trafficking. Vision-based maritime surveillance is challenging mainly due to visibility issues at night, wh…

Action DetectionActivity DetectionObject Tracking

A Video-based Detector for Suspicious Activity in Examination with OpenPose

2023-07-21 · Reuben Moyo, Stanley Ndebvu, Michael Zimba, Jimmy Mbelwa

Examinations are a crucial part of the learning process, and academic institutions invest significant resources into maintaining their integrity by preventing cheating from students or facilitators. However, cheating has…

Fairness

Detecting Suspicious Commenter Mob Behaviors on YouTube Using Graph2Vec

2023-11-09 · Shadi Shajari, Mustafa Alassad, Nitin Agarwal

YouTube, a widely popular online platform, has transformed the dynamics of con-tent consumption and interaction for users worldwide. With its extensive range of content crea-tors and viewers, YouTube serves as a hub for …