Fusing Video and Inertial Sensor Data for Walking Person Identification
An autonomous computer system (such as a robot) typically needs to identify, locate, and track persons appearing in its sight. However, most solutions have their limitations regarding efficiency, practicability, or environmental constraints. In this paper, we propose an effective and practical system which combines video and inertial sensors for person identification (PID). Persons who do different activities are easy to identify. To show the robustness and potential of our system, we propose a walking person identification (WPID) method to identify persons walking at the same time. By comparing features derived from both video and inertial sensor data, we can associate sensors in smartphones with human objects in videos. Results show that the correctly identified rate of our WPID method can up to 76% in 2 seconds.
Code (0)
등록된 구현이 없습니다.
Tasks
Person IdentificationSimilar Papers 제목 키워드 기반
Total capture: 3D human pose estimation fusing video and inertial sensors
We present an algorithm for fusing multi-viewpoint video (MVV) with inertial measurement unit (IMU) sensor data to accurately estimate 3D human pose. A 3-D convolutional neural network is used to learn a pose embedding f…
3D Human Pose EstimationPose EstimationMarkerless Motion Tracking with Noisy Video and IMU Data
Marker-based motion capture, considered the gold standard in human motion analysis, is expensive and requires trained personnel. Advances in inertial sensing and computer vision offer new opportunities to obtain research…
PrognosisFusing uncalibrated IMUs and handheld smartphone video to reconstruct knee kinematics
Video and wearable sensor data provide complementary information about human movement. Video provides a holistic understanding of the entire body in the world while wearable sensors provide high-resolution measurements o…
Markerless Motion CaptureSensor FusionSeq2Seq RNN based Gait Anomaly Detection from Smartphone Acquired Multimodal Motion Data
Smartphones and wearable devices are fast growing technologies that, in conjunction with advances in wireless sensor hardware, are enabling ubiquitous sensing applications. Wearables are suitable for indoor and outdoor s…
Anomaly DetectionDeep Gait Tracking With Inertial Measurement Unit
This paper presents a convolutional neural network based foot motion tracking with only six-axis Inertial-Measurement-Unit (IMU) sensor data. The presented approach can adapt to various walking conditions by adopting dif…
Diversity