Learning Robot Visual Navigation in Crowds via Intention-Aware Scene Representations
Robot crowd navigation requires the ability to infer human intentions while accounting for the structural constraints of the environment. Currently, deep reinforcement learning (DRL) provides a promising method for learning navigation policies that understand human intentions. However, most of them rely on limited scene representations, treating pedestrians as simple 2D points and ignoring rich visual cues from both humans and the environment. To address this issue, we introduce iCrowdNav, a novel visual crowd navigation method with intention-aware scene representations, to encode behavioral and structural context from egocentric visual observations. Our method employs two key components: a spatio-temporal encoder for extracting occupancy features of the scene, and Intent-Interact Former (I$^2$ Former), an attention-based module that encodes human poses to infer pedestrians' motion intentions. These features are integrated into a compact state embedding that supports effective DRL policy training. Extensive experiments show that our method achieves superior performance over baselines, and real-world deployment demonstrates vision-based crowd navigation.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningVisual NavigationSimilar Papers 제목 키워드 기반
Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph
We study the problem of safe and intention-aware robot navigation in dense and interactive crowds. Most previous reinforcement learning (RL) based methods fail to consider different types of interactions among all agents…
Graph Neural NetworkMotion Planningreinforcement-learningRobot Navigation+2Learning Contact-based Navigation in Crowds
Navigation strategies that intentionally incorporate contact with humans (i.e. "contact-based" social navigation) in crowded environments are largely unexplored even though collision-free social navigation is a well stud…
NavigateSocial NavigationLearning a Group-Aware Policy for Robot Navigation
Human-aware robot navigation promises a range of applications in which mobile robots bring versatile assistance to people in common human environments. While prior research has mostly focused on modeling pedestrians as i…
Deep Reinforcement LearningRobot NavigationSocial NavigationCoNav: A Benchmark for Human-Centered Collaborative Navigation
Human-robot collaboration, in which the robot intelligently assists the human with the upcoming task, is an appealing objective. To achieve this goal, the agent needs to be equipped with a fundamental collaborative navig…
NavigateOptimal-Horizon Social Robot Navigation in Heterogeneous Crowds
Navigating social robots in dense, dynamic crowds is challenging due to environmental uncertainty and complex human-robot interactions. While Model Predictive Control (MPC) offers strong real-time performance, its relian…
Reinforcement LearningRobot Navigation