Video Based Fall Detection Using Human Poses
Video based fall detection accuracy has been largely improved due to the recent progress on deep convolutional neural networks. However, there still exists some challenges, such as lighting variation, complex background, which degrade the accuracy and generalization ability of these approaches. Meanwhile, large computation cost limits the application of existing fall detection approaches. To alleviate these problems, a video based fall detection approach using human poses is proposed in this paper. First, a lightweight pose estimator extracts 2D poses from video sequences and then 2D poses are lifted to 3D poses. Second, we introduce a robust fall detection network to recognize fall events using estimated 3D poses, which increases respective filed and maintains low computation cost by dilated convolutions. The experimental results show that the proposed fall detection approach achieves a high accuracy of 99.83% on large benchmark action recognition dataset NTU RGB+D and real-time performance of 18 FPS on a non-GPU platform and 63 FPS on a GPU platform.
Code (1)
Tasks
Action RecognitionGPUSimilar Papers 제목 키워드 기반
ElderFallGuard: Real-Time IoT and Computer Vision-Based Fall Detection System for Elderly Safety
For the elderly population, falls pose a serious and increasing risk of serious injury and loss of independence. In order to overcome this difficulty, we present ElderFallGuard: A Computer Vision Based IoT Solution for E…
Pose EstimationUniPose: Unified Human Pose Estimation in Single Images and Videos
We propose UniPose, a unified framework for human pose estimation, based on our "Waterfall" Atrous Spatial Pooling architecture, that achieves state-of-art-results on several pose estimation metrics. Current pose estimat…
Pose EstimationSkeleton Based Action RecognitionCutup and Detect: Human Fall Detection on Cutup Untrimmed Videos Using a Large Foundational Video Understanding Model
This work explores the performance of a large video understanding foundation model on the downstream task of human fall detection on untrimmed video and leverages a pretrained vision transformer for multi-class action de…
Action DetectionAction LocalizationTemporal Action LocalizationVideo UnderstandingFADE: A Dataset for Detecting Falling Objects around Buildings in Video
Falling objects from buildings can cause severe injuries to pedestrians due to the great impact force they exert. Although surveillance cameras are installed around some buildings, it is challenging for humans to capture…
Moving Object DetectionObjectobject-detectionObject Detection+1OmniFall: A Unified Staged-to-Wild Benchmark for Human Fall Detection
Current video-based fall detection research mostly relies on small, staged datasets with significant domain biases concerning background, lighting, and camera setup resulting in unknown real-world performance. We introdu…
Video SegmentationVideo Semantic Segmentation