paper-with-me

Papers

TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotion

2026-06-04 · Peizhuo Li, Hongyi Li, Mingfeng Fan, Fangzhou Xu, Shuhao Liao, Yuxuan Ma, Zicheng Zeng, Ze Wang, Yongbin Jin, Yuhong Cao, Hongtao Wang, Guillaume Sartoretti arxiv

Agile humanoid locomotion across diverse challenging terrain demands both wide perceptual coverage and precise local geometry understanding. Motivated by the way humans selectively look at relevant terrain during locomotion, we introduce TAGA, a Terrain-aware Active Gaze learning framework for Attention-based humanoid control. By fusing vision, proprioception, and motion commands, our framework guides the model to learn anticipatory cues and actively attend to specific areas of the height scan, selectively using these informative regions for the downstream network. This adaptively increases the information density of observations under tight onboard computational constraints, thus enabling fine-grained perceptive locomotion over larger-scale terrains. We find that such gaze behaviors can naturally emerge through reinforcement learning alone, without requiring additional supervision or explicit guidance, significantly improve training efficiency. As a result, the trained policy demonstrates robust and generalizable locomotion in simulation and on hardware, including reliable terrain-aware foothold selection, elevated-platform traversal, competitive sparse-foothold traversal, and the largest reported real-world gap traversal distance of 1.2m among perceptive humanoid locomotion systems, while maintaining stability under severe perceptual disturbances and environmental interference.

📄 PDF Abstract BibTeX arXiv:2606.05880

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Differential Contrastive Training for Gaze Estimation

2025-02-27 · Lin Zhang, Yi Tian, XiYun Wang, Wanru Xu 외

The complex application scenarios have raised critical requirements for precise and generalizable gaze estimation methods. Recently, the pre-trained CLIP has achieved remarkable performance on various vision tasks, but i…

Gaze Estimation

Generating a Terrain-Robustness Benchmark for Legged Locomotion: A Prototype via Terrain Authoring and Active Learning

2022-08-16 · Chong Zhang, Lizhi Yang

Terrain-aware locomotion has become an emerging topic in legged robotics. However, it is hard to generate diverse, challenging, and realistic unstructured terrains in simulation, which limits the way researchers evaluate…

Active Learning

Intent at a Glance: Gaze-Guided Robotic Manipulation via Foundation Models

2026-01-08 · Tracey Yee Hsin Tay, Xu Yan, Jonathan Ouyang, Daniel Wu 외 arxiv

Designing intuitive interfaces for robotic control remains a central challenge in enabling effective human-robot interaction, particularly in assistive care settings. Eye gaze offers a fast, non-intrusive, and intent-ric…

Autonomous Control of a Novel Closed Chain Five Bar Active Suspension via Deep Reinforcement Learning

2024-06-27 · Nishesh Singh, Sidharth Ramesh, Abhishek Shankar, Jyotishka Duttagupta 외

Planetary exploration requires traversal in environments with rugged terrains. In addition, Mars rovers and other planetary exploration robots often carry sensitive scientific experiments and components onboard, which mu…

Deep Reinforcement Learning

TRANS: Terrain-aware Reinforcement Learning for Agile Navigation of Quadruped Robots under Social Interactions

2026-02-13 · Wei Zhu, Irfan Tito Kurniawan, Ye Zhao, Mitsuhiro Hayashibe arxiv

This study introduces TRANS: Terrain-aware Reinforcement learning for Agile Navigation under Social interactions, a deep reinforcement learning (DRL) framework for quadrupedal social navigation over unstructured terrains…

Reinforcement LearningMotion Planning