paper-with-me

홈 › Papers

Traversing Narrow Paths: A Two-Stage Reinforcement Learning Framework for Robust and Safe Humanoid Walking

2025-08-28 · TianChen Huang, Runchen Xu, Yu Wang, Wei Gao, Shiwu Zhang arxiv

Traversing narrow paths is challenging for humanoid robots due to the sparse and safety-critical footholds required. Purely template-based or end-to-end reinforcement learning-based methods suffer from such harsh terrains. This paper proposes a two stage training framework for such narrow path traversing tasks, coupling a template-based foothold planner with a low-level foothold tracker from Stage-I training and a lightweight perception aided foothold modifier from Stage-II training. With the curriculum setup from flat ground to narrow paths across stages, the resulted controller in turn learns to robustly track and safely modify foothold targets to ensure precise foot placement over narrow paths. This framework preserves the interpretability from the physics-based template and takes advantage of the generalization capability from reinforcement learning, resulting in easy sim-to-real transfer. The learned policies outperform purely template-based or reinforcement learning-based baselines in terms of success rate, centerline adherence and safety margins. Validation on a Unitree G1 humanoid robot yields successful traversal of a 0.2m wide and 3m long beam for 20 trials without any failure.

📄 PDF Abstract BibTeX arXiv:2508.20661

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Sparsifying networks by traversing Geodesics

2020-12-12 · NeurIPS Workshop DL-IG 2020 12 · Guruprasad Raghavan, Matt Thomson

The geometry of weight spaces and functional manifolds of neural networks play an important role towards 'understanding' the intricacies of ML. In this paper, we attempt to solve certain open questions in ML, by viewing …

Tree-Structured Reinforcement Learning for Sequential Object Localization

2017-03-08 · NeurIPS 2016 12 · Zequn Jie, Xiaodan Liang, Jiashi Feng, Xiaojie Jin 외

Existing object proposal algorithms usually search for possible object regions over multiple locations and scales separately, which ignore the interdependency among different objects and deviate from the human perception…

DiversityObjectObject Localizationreinforcement-learning+2

Localization in Multipath Environments via Active Sensing with Reconfigurable Intelligent Surfaces

2024-06-27 · Yinghan Li, Wei Yu

This letter investigates an uplink pilot-based wireless indoor localization problem in a multipath environment for a single-input single-output (SISO) narrowband communication system aided by reconfigurable intelligent s…

Indoor Localization

GeCCo -- a Generalist Contact-Conditioned Policy for Loco-Manipulation Skills on Legged Robots

2025-09-22 · Vassil Atanassov, Wanming Yu, Siddhant Gangapurwala, James Wilson 외 arxiv

Most modern approaches to quadruped locomotion focus on using Deep Reinforcement Learning (DRL) to learn policies from scratch, in an end-to-end manner. Such methods often fail to scale, as every new problem or applicati…

Reinforcement Learning

Learning Highly Dynamic Skills Transition for Quadruped Jumping Through Constrained Space

2026-08-20 · Zeren Luo, Jiahui Zhang, Yimin Han, Ji Ma 외 arxiv

Although legged animals are capable of performing explosive motions while traversing confined spaces, replicating this behavior in quadrupedal robots has been a longstanding challenge. Here, we propose a hierarchical rei…

Hierarchical Reinforcement Learning