paper-with-me

Papers

Instance-Aware Predictive Navigation in Multi-Agent Environments

2021-01-14 · Jinkun Cao, Xin Wang, Trevor Darrell, Fisher Yu

In this work, we aim to achieve efficient end-to-end learning of driving policies in dynamic multi-agent environments. Predicting and anticipating future events at the object level are critical for making informed driving decisions. We propose an Instance-Aware Predictive Control (IPC) approach, which forecasts interactions between agents as well as future scene structures. We adopt a novel multi-instance event prediction module to estimate the possible interaction among agents in the ego-centric view, conditioned on the selected action sequence of the ego-vehicle. To decide the action at each step, we seek the action sequence that can lead to safe future states based on the prediction module outputs by repeatedly sampling likely action sequences. We design a sequential action sampling strategy to better leverage predicted states on both scene-level and instance-level. Our method establishes a new state of the art in the challenging CARLA multi-agent driving simulation environments without expert demonstration, giving better explainability and sample efficiency.

📄 PDF Abstract BibTeX arXiv:2101.05893

Code (1)

SysCV/spc2 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Collaborative Instance Navigation: Leveraging Agent Self-Dialogue to Minimize User Input

2024-12-02 · Francesco Taioli, Edoardo Zorzi, Gianni Franchi, Alberto Castellini 외

Existing embodied instance goal navigation tasks, driven by natural language, assume human users to provide complete and nuanced instance descriptions prior to the navigation, which can be impractical in the real world a…

object-detectionObject Detection

STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation

2026-08-28 · Yang Chen, Zhenyu Huang, Wenbo Fu, Danyang Peng 외 arxiv

Multimodal lifelong navigation requires an agent to autonomously explore unseen environments while sequentially completing navigation tasks specified by object categories, language descriptions, or reference images. Exis…

Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation

2024-02-25 · CVPR 2024 1 · Xiaohan Lei, Min Wang, Wengang Zhou, Li Li 외

As a new embodied vision task, Instance ImageGoal Navigation (IIN) aims to navigate to a specified object depicted by a goal image in an unexplored environment. The main challenge of this task lies in identifying the tar…

Navigate

IVLMap: Instance-Aware Visual Language Grounding for Consumer Robot Navigation

2024-03-28 · Jiacui Huang, Hongtao Zhang, Mingbo Zhao, Zhou Wu

Vision-and-Language Navigation (VLN) is a challenging task that requires a robot to navigate in photo-realistic environments with human natural language promptings. Recent studies aim to handle this task by constructing …

AttributeLanguage ModellingLarge Language ModelNavigate+2

Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation

2026-06-02 · Xunyi Zhao, Sihao Lin, Gengze Zhou, Zerui Li 외 arxiv

Instance Goal Navigation (IGN) requires an embodied agent to find a specific object instance among distractors from an under-specified natural-language description. Such ambiguity often cannot be resolved from perception…