paper-with-me

홈 › Papers

Control Transformer: Robot Navigation in Unknown Environments through PRM-Guided Return-Conditioned Sequence Modeling

2022-11-11 · Daniel Lawson, Ahmed H. Qureshi

Learning long-horizon tasks such as navigation has presented difficult challenges for successfully applying reinforcement learning to robotics. From another perspective, under known environments, sampling-based planning can robustly find collision-free paths in environments without learning. In this work, we propose Control Transformer that models return-conditioned sequences from low-level policies guided by a sampling-based Probabilistic Roadmap (PRM) planner. We demonstrate that our framework can solve long-horizon navigation tasks using only local information. We evaluate our approach on partially-observed maze navigation with MuJoCo robots, including Ant, Point, and Humanoid. We show that Control Transformer can successfully navigate through mazes and transfer to unknown environments. Additionally, we apply our method to a differential drive robot (Turtlebot3) and show zero-shot sim2real transfer under noisy observations.

📄 PDF Abstract BibTeX arXiv:2211.06407

Code (0)

등록된 구현이 없습니다.

Tasks

MuJoCoNavigateRobot Navigation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Corridor-based Adaptive Control Barrier and Lyapunov Functions for Safe Mobile Robot Navigation

2025-07-19 · Nicholas Mohammad, Nicola Bezzo arxiv

Safe navigation in unknown and cluttered environments remains a challenging problem in robotics. Model Predictive Contour Control (MPCC) has shown promise for performant obstacle avoidance by enabling precise and agile t…

Robot Navigation

Reinforcement Learning for Robot Navigation with Adaptive Forward Simulation Time (AFST) in a Semi-Markov Model

2021-08-13 · Yu'an Chen, Ruosong Ye, Ziyang Tao, Hongjian Liu 외

Deep reinforcement learning (DRL) algorithms have proven effective in robot navigation, especially in unknown environments, by directly mapping perception inputs into robot control commands. However, most existing method…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Robot Navigation

Behavior-based Navigation of Mobile Robot in Unknown Environments Using Fuzzy Logic and Multi-Objective Optimization

2017-03-09 · Thi Thanh Van Nguyen, Manh Duong Phung, Quang Vinh Tran

This study proposes behavior-based navigation architecture, named BBFM, to deal with the problem of navigating the mobile robot in unknown environments in the presence of obstacles and local minimum regions. In the archi…

Dissipative Avoidance Feedback for Reactive Navigation Under Second-Order Dynamics

2024-10-03 · Lyes Smaili, Zhiqi Tang, Soulaimane Berkane, Tarek Hamel

This paper addresses the problem of autonomous robot navigation in unknown, obstacle-filled environments with second-order dynamics by proposing a Dissipative Avoidance Feedback (DAF). Compared to the Artificial Potentia…

PositionRobot Navigation

GP-guided MPPI for Efficient Navigation in Complex Unknown Cluttered Environments

2023-07-08 · Ihab S. Mohamed, Mahmoud Ali, Lantao Liu

Robotic navigation in unknown, cluttered environments with limited sensing capabilities poses significant challenges in robotics. Local trajectory optimization methods, such as Model Predictive Path Intergal (MPPI), are …

Autonomous NavigationCollision AvoidanceGPU