Robotic Classification of Divers' Swimming States using Visual Pose Keypoints as IMUs
Traditional human activity recognition uses either direct image analysis or data from wearable inertial measurement units (IMUs), but can be ineffective in challenging underwater environments. We introduce a novel hybrid approach that bridges this gap to monitor scuba diver safety. Our method leverages computer vision to generate high-fidelity motion data, effectively creating a ``pseudo-IMU'' from a stream of 3D human joint keypoints. This technique circumvents the critical problem of wireless signal attenuation in water, which plagues conventional diver-worn sensors communicating with an Autonomous Underwater Vehicle (AUV). We apply this system to the vital task of identifying anomalous scuba diver behavior that signals the onset of a medical emergency such as cardiac arrest -- a leading cause of scuba diving fatalities. By integrating our classifier onboard an AUV and conducting experiments with simulated distress scenarios, we demonstrate the utility and effectiveness of our method for advancing robotic monitoring and diver safety.
Code (0)
등록된 구현이 없습니다.
Tasks
Human Activity RecognitionSimilar Papers 제목 키워드 기반
A Novel Bio-Inspired Fish Robot with Tunable Stiffness via Particle Jamming
Fish achieve efficient swimming across varied speeds through active modulation of their body flexibility. To explore the effects of tunable stiffness on swimming performance, we present a bio-inspired freely swimming fis…
Model-based Optimization of Anguilliform Swimming Gaits for Soft Robotic Applications
In this paper, we introduce the Soft Lamprey-Inspired Dual Environment Robot (SLIDER) and a proper modeling and optimization procedure employed to design the robot. We represent the primary fluid environment actions - in…
Design, Modeling and Direction Control of a Wire-Driven Robotic Fish Based on a 2-DoF Crank-Slider Mechanism
Robotic fish have attracted growing attention in recent years owing to their biomimetic design and potential applications in environmental monitoring and biological surveys. Among robotic fish employing the Body-Caudal F…
An Amphibious Untethered Inchworm Soft Robot for Fast Crawling Locomotion
Untethered soft robots are essential for advancing the real-world deployment of soft robotic systems in diverse and multitasking environments. Inspired by soft-bodied inchworm, we present a fully untethered soft robot wi…
Cuttlebot: a platform demonstration for complex, autonomous, bio-inspired swimmers
Increasing interest in deep-sea operations and resources motivates the development of ecologically sensitive but environmentally durable robots. Dielectric elastomer actuator artificial muscles are good candidates for po…