paper-with-me

홈 › Papers

Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting

2026-04-14 · Ziyuan Xia, Jingyi Xu, Chong Cui, Yuanhong Yu, Jiazhao Zhang, Qingsong Yan, Tao Ni, Junbo Chen, Xiaowei Zhou, Hujun Bao, Ruizhen Hu, Sida Peng arxiv

Training embodied AI agents depends critically on the visual fidelity of simulation environments and the ability to model dynamic humans. Current simulators rely on mesh-based rasterization with limited visual realism, and their support for dynamic human avatars, where available, is constrained to mesh representations, hindering agent generalization to human-populated real-world scenarios. We present Habitat-GS, a navigation-centric embodied AI simulator extended from Habitat-Sim that integrates 3D Gaussian Splatting scene rendering and drivable gaussian avatars while maintaining full compatibility with the Habitat ecosystem. Our system implements a 3DGS renderer for real-time photorealistic rendering and supports scalable 3DGS asset import from diverse sources. For dynamic human modeling, we introduce a gaussian avatar module that enables each avatar to simultaneously serve as a photorealistic visual entity and an effective navigation obstacle, allowing agents to learn human-aware behaviors in realistic settings. Experiments on point-goal navigation demonstrate that agents trained on 3DGS scenes achieve stronger cross-domain generalization, with mixed-domain training being the most effective strategy. Evaluations on avatar-aware navigation further confirm that gaussian avatars enable effective human-aware navigation. Finally, performance benchmarks validate the system's scalability across varying scene complexity and avatar counts.

📄 PDF Abstract BibTeX arXiv:2604.12626

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Generalization

Similar Papers 제목 키워드 기반

ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AI

2021-09-16 · Guanxiong Chen, HaoYu Yang, Ian M. Mitchell

We introduce ROS-X-Habitat, a software interface that bridges the AI Habitat platform for embodied learning-based agents with other robotics resources via ROS. This interface not only offers standardized communication pr…

Learning to navigate efficiently and precisely in real environments

2024-01-25 · CVPR 2024 1 · Guillaume Bono, Hervé Poirier, Leonid Antsfeld, Gianluca Monaci 외

In the context of autonomous navigation of terrestrial robots, the creation of realistic models for agent dynamics and sensing is a widespread habit in the robotics literature and in commercial applications, where they a…

Autonomous NavigationNavigate

On Embodied Visual Navigation in Real Environments Through Habitat

2020-10-26 · Marco Rosano, Antonino Furnari, Luigi Gulino, Giovanni Maria Farinella

Visual navigation models based on deep learning can learn effective policies when trained on large amounts of visual observations through reinforcement learning. Unfortunately, collecting the required experience in the r…

Domain AdaptationUnsupervised Domain AdaptationVisual Navigation

Sim2Real Predictivity: Does Evaluation in Simulation Predict Real-World Performance?

2019-12-13 · Abhishek Kadian, Joanne Truong, Aaron Gokaslan, Alexander Clegg 외

Does progress in simulation translate to progress on robots? If one method outperforms another in simulation, how likely is that trend to hold in reality on a robot? We examine this question for embodied PointGoal naviga…

PointGoal NavigationVisual Navigation

Habitat: A Platform for Embodied AI Research

2019-04-02 · ICCV 2019 10 · Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao 외

We present Habitat, a platform for research in embodied artificial intelligence (AI). Habitat enables training embodied agents (virtual robots) in highly efficient photorealistic 3D simulation. Specifically, Habitat cons…

BenchmarkingGPUInstruction FollowingPointGoal Navigation+2