A Cloud-based Deep Learning Framework for Early Detection of Pushing at Crowded Event Entrances
Crowding at the entrances of large events may lead to critical and life-threatening situations, particularly when people start pushing each other to reach the event faster. Automatic and timely identification of pushing behavior would help organizers and security forces to intervene early and mitigate dangerous situations. In this paper, we propose a cloud-based deep learning framework for automatic early detection of pushing in crowded event entrances. The proposed framework initially modifies and trains the EfficientNetV2B0 Convolutional Neural Network model. Subsequently, it integrates the adapted model with an accurate and fast pre-trained deep optical flow model with the color wheel method to analyze video streams and identify pushing patches in real-time. Moreover, the framework uses live capturing technology and a cloud-based environment to collect video streams of crowds in real-time and provide early-stage results. A novel dataset is generated based on five real-world experiments and their associated ground truth data to train the adapted EfficientNetV2B0 model. The experimental setups simulated a crowded event entrance, while the ground truths for each video experiment was generated manually by social psychologists. Several experiments on the videos and the generated dataset are carried out to evaluate the accuracy and annotation delay time of the proposed framework. The experimental results show that the proposed framework identified pushing behaviors with an accuracy rate of 87% within a reasonable delay time.
Code (1)
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
Learning better representations for crowded pedestrians in offboard LiDAR-camera 3D tracking-by-detection
Perceiving pedestrians in highly crowded urban environments is a difficult long-tail problem for learning-based autonomous perception. Speeding up 3D ground truth generation for such challenging scenes is performance-cri…
3D Pedestrian TrackingMultiple Object TrackingObject TrackingSTCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes
Accurately detecting and tracking pedestrians in 3D space is challenging due to large variations in rotations, poses and scales. The situation becomes even worse for dense crowds with severe occlusions. However, existing…
3D Object DetectionPedestrian DetectionSensor FusionProgressive End-to-End Object Detection in Crowded Scenes
In this paper, we propose a new query-based detection framework for crowd detection. Previous query-based detectors suffer from two drawbacks: first, multiple predictions will be inferred for a single object, typically i…
Objectobject-detectionObject DetectionCrowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes
In computer vision, object detection is an important task that finds its application in many scenarios. However, obtaining extensive labels can be challenging, especially in crowded scenes. Recently, the Segment Anything…
Human Instance SegmentationInstance Segmentationobject-detectionObject Detection+1BBoxMaskPose v2: Expanding Mutual Conditioning to 3D
Most 2D human pose estimation benchmarks are nearly saturated, with the exception of crowded scenes. We introduce PMPose, a top-down 2D pose estimator that incorporates the probabilistic formulation and the mask-conditio…
2D Human Pose Estimation3D Pose EstimationPose Prediction