paper-with-me

홈 › Papers

Learning Your Way Without Map or Compass: Panoramic Target Driven Visual Navigation

2019-09-20 · David Watkins-Valls, Jingxi Xu, Nicholas Waytowich, Peter Allen

We present a robot navigation system that uses an imitation learning framework to successfully navigate in complex environments. Our framework takes a pre-built 3D scan of a real environment and trains an agent from pre-generated expert trajectories to navigate to any position given a panoramic view of the goal and the current visual input without relying on map, compass, odometry, or relative position of the target at runtime. Our end-to-end trained agent uses RGB and depth (RGBD) information and can handle large environments (up to $1031m^2$) across multiple rooms (up to $40$) and generalizes to unseen targets. We show that when compared to several baselines our method (1) requires fewer training examples and less training time, (2) reaches the goal location with higher accuracy, and (3) produces better solutions with shorter paths for long-range navigation tasks.

📄 PDF Abstract BibTeX arXiv:1909.09295

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningNavigatePositionReinforcement LearningRobot NavigationVisual Navigation

Similar Papers 제목 키워드 기반

Neural Augmentation Based Panoramic High Dynamic Range Stitching

2024-09-07 · Chaobing Zheng, Yilun Xu, Weihai Chen, Shiqian Wu 외

Due to saturated regions of inputting low dynamic range (LDR) images and large intensity changes among the LDR images caused by different exposures, it is challenging to produce an information enriched panoramic LDR imag…

DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation

2023-10-19 · Bangbang Yang, Wenqi Dong, Lin Ma, WenBo Hu 외

Diffusion-based methods have achieved prominent success in generating 2D media. However, accomplishing similar proficiencies for scene-level mesh texturing in 3D spatial applications, e.g., XR/VR, remains constrained, pr…

3D geometryTexture Synthesis

Open Panoramic Segmentation

2024-07-02 · Junwei Zheng, Ruiping Liu, Yufan Chen, Kunyu Peng 외

Panoramic images, capturing a 360{\deg} field of view (FoV), encompass omnidirectional spatial information crucial for scene understanding. However, it is not only costly to obtain training-sufficient dense-annotated pan…

Open-Vocabulary Panoramic Semantic Segmentation

Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration

2021-05-31 · Yuhang He, Wentao Yu, Jie Han, Xing Wei 외

In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-…

Multi-Object TrackingObject TrackingRobot Navigation

Multi-source Domain Adaptation for Panoramic Semantic Segmentation

2024-08-29 · Jing Jiang, Sicheng Zhao, Jiankun Zhu, Wenbo Tang 외

Unsupervised domain adaptation methods for panoramic semantic segmentation utilize real pinhole images or low-cost synthetic panoramic images to transfer segmentation models to real panoramic images. However, these metho…

Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain Adaptation