Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) International Space Station Astrobee Testing

2025-12-03 · Samantha Chapin, Kenneth Stewart, Roxana Leontie, Carl Glen Henshaw arxiv

The US Naval Research Laboratory's (NRL's) Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) experiment pioneers the use of reinforcement learning (RL) for control of free-flying robots in the zero-gravity (zero-G) environment of space. On Tuesday, May 27th 2025 the APIARY team conducted the first ever, to our knowledge, RL control of a free-flyer in space using the NASA Astrobee robot on-board the International Space Station (ISS). A robust 6-degrees of freedom (DOF) control policy was trained using an actor-critic Proximal Policy Optimization (PPO) network within the NVIDIA Isaac Lab simulation environment, randomizing over goal poses and mass distributions to enhance robustness. This paper details the simulation testing, ground testing, and flight validation of this experiment. This on-orbit demonstration validates the transformative potential of RL for improving robotic autonomy, enabling rapid development and deployment (in minutes to hours) of tailored behaviors for space exploration, logistics, and real-time mission needs.

📄 PDF Abstract BibTeX arXiv:2512.03729

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Large-Scale Multi-Robot Assembly Planning for Autonomous Manufacturing

2023-10-31 · Kyle Brown, Dylan M. Asmar, Mac Schwager, Mykel J. Kochenderfer

Mobile autonomous robots have the potential to revolutionize manufacturing processes. However, employing large robot fleets in manufacturing requires addressing challenges including collision-free movement in a shared wo…

Leveraging Procedural Generation for Learning Autonomous Peg-in-Hole Assembly in Space

2024-05-02 · Andrej Orsula, Matthieu Geist, Miguel Olivares-Mendez, Carol Martinez

The ability to autonomously assemble structures is crucial for the development of future space infrastructure. However, the unpredictable conditions of space pose significant challenges for robotic systems, necessitating…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Backward Layout Search for Sequence-Constrained Robotic Assembly

2026-08-19 · Xi Zhang, Jiancong Dai, Hao Chen, Zhengtao Hu 외 arxiv

Robotic assembly layout planning must determine the assembly site and the initial pose of each part while ensuring collision-free execution of a prescribed assembly sequence. This problem is challenging because the obsta…

Motion Planning

Physics-Aware Combinatorial Assembly Sequence Planning using Data-free Action Masking

2024-08-19 · Ruixuan Liu, Alan Chen, WeiYe Zhao, Changliu Liu

Combinatorial assembly uses standardized unit primitives to build objects that satisfy user specifications. This paper studies assembly sequence planning (ASP) for physical combinatorial assembly. Given the shape of the …

Deep Reinforcement Learning Object reinforcement-learning Reinforcement Learning+1

Learning to Assemble the Soma Cube with Legal-Action Masked DQN and Safe ZYZ Regrasp on a Doosan M0609

2025-08-29 · Jaehong Oh, Seungjun Jung, Sawoong Kim arxiv

This paper presents the first comprehensive application of legal-action masked Deep Q-Networks with safe ZYZ regrasp strategies to an underactuated gripper-equipped 6-DOF collaborative robot for autonomous Soma cube asse…

Reinforcement Learning Motion Planning