paper-with-me

홈 › Papers

SITUATE: Indoor Human Trajectory Prediction through Geometric Features and Self-Supervised Vision Representation

2024-09-01 · Luigi Capogrosso, Andrea Toaiari, Andrea Avogaro, Uzair Khan, Aditya Jivoji, Franco Fummi, Marco Cristani

Patterns of human motion in outdoor and indoor environments are substantially different due to the scope of the environment and the typical intentions of people therein. While outdoor trajectory forecasting has received significant attention, indoor forecasting is still an underexplored research area. This paper proposes SITUATE, a novel approach to cope with indoor human trajectory prediction by leveraging equivariant and invariant geometric features and a self-supervised vision representation. The geometric learning modules model the intrinsic symmetries and human movements inherent in indoor spaces. This concept becomes particularly important because self-loops at various scales and rapid direction changes often characterize indoor trajectories. On the other hand, the vision representation module is used to acquire spatial-semantic information about the environment to predict users' future locations more accurately. We evaluate our method through comprehensive experiments on the two most famous indoor trajectory forecasting datasets, i.e., TH\"OR and Supermarket, obtaining state-of-the-art performance. Furthermore, we also achieve competitive results in outdoor scenarios, showing that indoor-oriented forecasting models generalize better than outdoor-oriented ones. The source code is available at https://github.com/intelligolabs/SITUATE.

📄 PDF Abstract BibTeX arXiv:2409.00774

Code (1)

intelligolabs/situate 공식 구현

Tasks

Trajectory ForecastingTrajectory Prediction

Similar Papers 제목 키워드 기반

SAW-Bench: Learning Situated Awareness in the Real World

2026-02-18 · Chuhan Li, Rilyn Han, Joy Hsu, Yongyuan Liang 외 arxiv

A core aspect of human perception is situated awareness, the ability to relate ourselves to the surrounding physical environment and reason over possible actions in context. However, most existing benchmarks for multimod…

Spatial Reasoning

Towards Robust Human Trajectory Prediction in Raw Videos

2021-08-18 · Rui Yu, Zihan Zhou

Human trajectory prediction has received increased attention lately due to its importance in applications such as autonomous vehicles and indoor robots. However, most existing methods make predictions based on human-labe…

Autonomous VehiclesPredictionTrajectory ForecastingTrajectory Prediction

Learning Continuous Environment Fields via Implicit Functions

2021-11-27 · ICLR 2022 4 · Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang 외

We propose a novel scene representation that encodes reaching distance -- the distance between any position in the scene to a goal along a feasible trajectory. We demonstrate that this environment field representation ca…

PositionTrajectory Prediction

Obstacle Avoidance through Deep Networks based Intermediate Perception

2017-04-27 · Shichao Yang, Sandeep Konam, Chen Ma, Stephanie Rosenthal 외

Obstacle avoidance from monocular images is a challenging problem for robots. Though multi-view structure-from-motion could build 3D maps, it is not robust in textureless environments. Some learning based methods exploit…

Situated Instruction Following

2024-07-15 · So Yeon Min, Xavi Puig, Devendra Singh Chaplot, Tsung-Yen Yang 외

Language is never spoken in a vacuum. It is expressed, comprehended, and contextualized within the holistic backdrop of the speaker's history, actions, and environment. Since humans are used to communicating efficiently …

Instruction Following