Enhancing Human Action Recognition and Violence Detection Through Deep Learning Audiovisual Fusion
This paper proposes a hybrid fusion-based deep learning approach based on two different modalities, audio and video, to improve human activity recognition and violence detection in public places. To take advantage of audiovisual fusion, late fusion, intermediate fusion, and hybrid fusion-based deep learning (HFBDL) are used and compared. Since the objective is to detect and recognize human violence in public places, Real-life violence situation (RLVS) dataset is expanded and used. Simulating results of HFBDL show 96.67\% accuracy on validation data, which is more accurate than the other state-of-the-art methods on this dataset. To showcase our model's ability in real-world scenarios, another dataset of 54 sounded videos of both violent and non-violent situations was recorded. The model could successfully detect 52 out of 54 videos correctly. The proposed method shows a promising performance on real scenarios. Thus, it can be used for human action recognition and violence detection in public places for security purposes.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionActivity RecognitionHuman Activity RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
DIFEM: Key-points Interaction based Feature Extraction Module for Violence Recognition in Videos
Violence detection in surveillance videos is a critical task for ensuring public safety. As a result, there is increasing need for efficient and lightweight systems for automatic detection of violent behaviours. In this …
JOSENet: A Joint Stream Embedding Network for Violence Detection in Surveillance Videos
The increasing proliferation of video surveillance cameras and the escalating demand for crime prevention have intensified interest in the task of violence detection within the research community. Compared to other actio…
Action RecognitionSelf-Supervised LearningHuman Activity Recognition Method for Moderate Violence Detection
Physical violence in public spaces is a significant public health concern, with minor incidents such as pushing often serving as precursors to more severe escalations. This research develops an automated system for the r…
Human Activity RecognitionComparative Analysis: Violence Recognition from Videos using Transfer Learning
Action recognition has become a hot topic in computer vision. However, the main applications of computer vision in video processing have focused on detection of relatively simple actions while complex events such as viol…
Action RecognitionBenchmarkingTransfer LearningImproving Video Violence Recognition with Human Interaction Learning on 3D Skeleton Point Clouds
Deep learning has proved to be very effective in video action recognition. Video violence recognition attempts to learn the human multi-dynamic behaviours in more complex scenarios. In this work, we develop a method for …
Action RecognitionTemporal Action Localization