paper-with-me

홈 › Papers

HEADS-UP: Head-Mounted Egocentric Dataset for Trajectory Prediction in Blind Assistance Systems

2024-09-30 · Yasaman Haghighi, Celine Demonsant, Panagiotis Chalimourdas, Maryam Tavasoli Naeini, Jhon Kevin Munoz, Bladimir Bacca, Silvan Suter, Matthieu Gani, Alexandre Alahi

In this paper, we introduce HEADS-UP, the first egocentric dataset collected from head-mounted cameras, designed specifically for trajectory prediction in blind assistance systems. With the growing population of blind and visually impaired individuals, the need for intelligent assistive tools that provide real-time warnings about potential collisions with dynamic obstacles is becoming critical. These systems rely on algorithms capable of predicting the trajectories of moving objects, such as pedestrians, to issue timely hazard alerts. However, existing datasets fail to capture the necessary information from the perspective of a blind individual. To address this gap, HEADS-UP offers a novel dataset focused on trajectory prediction in this context. Leveraging this dataset, we propose a semi-local trajectory prediction approach to assess collision risks between blind individuals and pedestrians in dynamic environments. Unlike conventional methods that separately predict the trajectories of both the blind individual (ego agent) and pedestrians, our approach operates within a semi-local coordinate system, a rotated version of the camera's coordinate system, facilitating the prediction process. We validate our method on the HEADS-UP dataset and implement the proposed solution in ROS, performing real-time tests on an NVIDIA Jetson GPU through a user study. Results from both dataset evaluations and live tests demonstrate the robustness and efficiency of our approach.

📄 PDF Abstract BibTeX arXiv:2409.20324

Code (0)

등록된 구현이 없습니다.

Tasks

GPUPredictionTrajectory Prediction

Similar Papers 제목 키워드 기반

Real-Time Simulated Avatar from Head-Mounted Sensors

2024-03-11 · CVPR 2024 1 · Zhengyi Luo, Jinkun Cao, Rawal Khirodkar, Alexander Winkler 외

We present SimXR, a method for controlling a simulated avatar from information (headset pose and cameras) obtained from AR / VR headsets. Due to the challenging viewpoint of head-mounted cameras, the human body is often …

Egocentric Pose EstimationHumanoid ControlPose Estimation

The Monado SLAM Dataset for Egocentric Visual-Inertial Tracking

2025-07-31 · Mateo de Mayo, Daniel Cremers, Taihú Pire arxiv

Humanoid robots and mixed reality headsets benefit from the use of head-mounted sensors for tracking. While advancements in visual-inertial odometry (VIO) and simultaneous localization and mapping (SLAM) have produced ne…

EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices

2021-12-14 · Siwei Zhang, Qianli Ma, Yan Zhang, Zhiyin Qian 외

Understanding social interactions from egocentric views is crucial for many applications, ranging from assistive robotics to AR/VR. Key to reasoning about interactions is to understand the body pose and motion of the int…

Motion Estimation

Pipeline for 3D reconstruction of the human body from AR/VR headset mounted egocentric cameras

2021-11-09 · Shivam Grover, Kshitij Sidana, Vanita Jain

In this paper, we propose a novel pipeline for the 3D reconstruction of the full body from egocentric viewpoints. 3-D reconstruction of the human body from egocentric viewpoints is a challenging task as the view is skewe…

3D ReconstructionPose Transfer

Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision

2025-03-08 · David C. Jeong, Aditya Puranik, James Vong, Vrushabh Abhijit Deogirikar 외

Egocentric human body estimation allows for the inference of user body pose and shape from a wearable camera's first-person perspective. Although research has used pose estimation techniques to overcome self-occlusions a…

Human Mesh RecoveryPose EstimationPosition