paper-with-me

Papers

MAction-SocialNav: Multi-Action Socially Compliant Navigation via Reasoning-enhanced Prompt Tuning

2025-12-25 · Zishuo Wang, Xinyu Zhang, Zhuonan Liu, Tomohito Kawabata, Daeun Song, Xuesu Xiao, Ling Xiao arxiv

Socially compliant navigation requires robots to move safely and appropriately in human-centered environments by respecting social norms. However, social norms are often ambiguous, and in a single scenario, multiple actions may be equally acceptable. Most existing methods simplify this problem by assuming a single correct action, which limits their ability to handle real-world social uncertainty. In this work, we propose MAction-SocialNav, an efficient vision language model for socially compliant navigation that explicitly addresses action ambiguity, enabling generating multiple plausible actions within one scenario. To enhance the model's reasoning capability, we introduce a novel meta-cognitive prompt (MCP) method. Furthermore, to evaluate the proposed method, we curate a multi-action socially compliant navigation dataset that accounts for diverse conditions, including crowd density, indoor and outdoor environments, and dual human annotations. The dataset contains 789 samples, each with three-turn conversation, split into 710 training samples and 79 test samples through random selection. We also design five evaluation metrics to assess high-level decision precision, safety, and diversity. Extensive experiments demonstrate that the proposed MAction-SocialNav achieves strong social reasoning performance while maintaining high efficiency, highlighting its potential for real-world human robot navigation. Compared with zero-shot GPT-4o and Claude, our model achieves substantially higher decision quality (APG: 0.595 vs. 0.000/0.025) and safety alignment (ER: 0.264 vs. 0.642/0.668), while maintaining real-time efficiency (1.524 FPS, over 3x faster).

📄 PDF Abstract BibTeX arXiv:2512.21722

Code (0)

등록된 구현이 없습니다.

Tasks

Robot Navigation

Similar Papers 제목 키워드 기반

E-SocialNav: Efficient Socially Compliant Navigation with Language Models

2026-03-21 · Ling Xiao, Daeun Song, Xuesu Xiao, Toshihiko Yamasaki arxiv

Language models (LMs) are increasingly applied to robotic navigation; however, existing benchmarks primarily emphasize navigation success rates while paying limited attention to social compliance. Moreover, relying on la…

Semantic Similarity

SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation

2025-11-26 · Ziyi Chen, Yingnan Guo, Zedong Chu, Minghua Luo 외 arxiv

Embodied navigation that adheres to social norms remains an open research challenge. Our SocialNav is a foundational model for socially-aware navigation with a hierarchical "brain-action" architecture, capable of underst…

Reinforcement Learning

SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuning

2025-12-15 · Tomohito Kawabata, Xinyu Zhang, Ling Xiao arxiv

For robots navigating in human-populated environments, safety and social compliance are equally critical, yet prior work has mostly emphasized safety. Socially compliant navigation that accounts for human comfort, social…

Semantic Similarity

SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation

2025-09-10 · Michael J. Munje, Chen Tang, Shuijing Liu, Zichao Hu 외 arxiv

Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-Language Models (VLMs) exhibit promising capabilities such as object re…

Visual Question AnsweringScene UnderstandingObject RecognitionRobot Navigation

SOPD-SocialNav: Selective On-Policy Distillation for Vision-Language Social Navigation

2026-07-22 · Xinyu Zhang, Zishuo Wang, Ling Xiao arxiv

Vision-language models have shown strong potential for social robot navigation by leveraging rich semantic understanding of complex environments and human behaviors. However, large scale VLMs are difficult to deploy on r…

Robot Navigation