paper-with-me

Papers

AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions

2026-01-07 · Hengxing Cai, Yijie Rao, Ligang Huang, Zanyang Zhong, Jinhan Dong, Jingjun Tan, Changhao Nai, Jue Hou, Wenhao Lu, Renxin Zhong arxiv

Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and sufficient scale simultaneously, making it difficult to systematically train and evaluate UAV VLN agents under realistic settings. To address this, we propose \textbf{AirNav}, a large-scale benchmark built on real urban aerial data, comprising 137K navigation samples with natural and diverse instructions generated via a human--LLM collaborative pipeline with 10 user personas. We conduct a systematic evaluation of representative approaches on AirNav, ranging from traditional models to multimodal large language models (MLLMs), under unified metrics with open-source implementations. We further propose \textbf{AirVLN-R1}, trained via supervised fine-tuning (SFT) and reinforcement fine-tuning (RFT), achieving state-of-the-art performance with a 51.82\% success rate on the test-unseen split. Real-world experiments on a physical UAV platform provide preliminary evidence of sim-to-real transferability, and our dataset and code are publicly available.

📄 PDF Abstract BibTeX arXiv:2601.03707

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

NAVCON: A Cognitively Inspired and Linguistically Grounded Corpus for Vision and Language Navigation

2024-12-17 · Karan Wanchoo, Xiaoye Zuo, Hannah Gonzalez, Soham Dan 외

We present NAVCON, a large-scale annotated Vision-Language Navigation (VLN) corpus built on top of two popular datasets (R2R and RxR). The paper introduces four core, cognitively motivated and linguistically grounded, na…

Few-Shot LearningVision and Language NavigationVision-Language Navigation

Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Vision-language navigation (VLN) is a challenging task due to its large searching space in the environment. To address this problem, previous works have proposed some methods of fine-tuning a large model that pretrained …

Domain AdaptationVision-Language Navigation

Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration

2022-03-08 · ACL 2022 5 · Xiwen Liang, Fengda Zhu, Lingling Li, Hang Xu 외

Vision-language navigation (VLN) is a challenging task due to its large searching space in the environment. To address this problem, previous works have proposed some methods of fine-tuning a large model that pretrained …

Domain AdaptationVision-Language Navigation

Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments

2017-11-20 · CVPR 2018 6 · Peter Anderson, Qi Wu, Damien Teney, Jake Bruce 외

A robot that can carry out a natural-language instruction has been a dream since before the Jetsons cartoon series imagined a life of leisure mediated by a fleet of attentive robot helpers. It is a dream that remains stu…

Reinforcement LearningTranslationVision and Language NavigationVisual Navigation+2

OpenFrontier: General Navigation with Visual-Language Grounded Frontiers

2026-03-05 · Esteban Padilla-Cerdio, Boyang Sun, Marc Pollefeys, Hermann Blum arxiv

Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-cra…

Vision-Language Navigation3D Reconstruction