From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent

2022-08-09 · Ganghun Lee, Minji Kim, Minsu Lee, Byoung-Tak Zhang

We present an automated learning framework for a robotic sketching agent that is capable of learning stroke-based rendering and motor control simultaneously. We formulate the robotic sketching problem as a deep decoupled hierarchical reinforcement learning; two policies for stroke-based rendering and motor control are learned independently to achieve sub-tasks for drawing, and form a hierarchy when cooperating for real-world drawing. Without hand-crafted features, drawing sequences or trajectories, and inverse kinematics, the proposed method trains the robotic sketching agent from scratch. We performed experiments with a 6-DoF robot arm with 2F gripper to sketch doodles. Our experimental results show that the two policies successfully learned the sub-tasks and collaborated to sketch the target images. Also, the robustness and flexibility were examined by varying drawing tools and surfaces.

📄 PDF Abstract BibTeX arXiv:2208.04833

Code (1)

northadventure/collagerl pytorch

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulation

2026-01-04 · Huajie Tan, Peterson Co, Yijie Xu, Shanyu Rong 외 arxiv

Long-horizon robotic manipulation is increasingly important for real-world deployment, requiring spatial disambiguation in complex layouts and temporal resilience under dynamic interaction. However, existing end-to-end a…

Sketch-to-Skill: Bootstrapping Robot Learning with Human Drawn Trajectory Sketches

2025-03-14 · Peihong Yu, Amisha Bhaskar, Anukriti Singh, Zahiruddin Mahammad 외

Training robotic manipulation policies traditionally requires numerous demonstrations and/or environmental rollouts. While recent Imitation Learning (IL) and Reinforcement Learning (RL) methods have reduced the number of…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Data Informed Residual Reinforcement Learning for High-Dimensional Robotic Tracking Control

2021-10-28 · Cong Li, Fangzhou Liu, Yongchao Wang, Martin Buss

The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application towards continuous robotic tracking control, especially for high-dimensional robots. This work proposes a data-infor…

reinforcement-learning Reinforcement Learning (RL)

A Novel Multi-Timescale Stability-Preserving Hierarchical Reinforcement Learning Controller Framework for Adaptive Control in High-Dimensional Dynamical Systems

2025-10-25 · Mohammad Ali Labbaf Khaniki, Fateme Taroodi, Benyamin Safizadeh arxiv

Controlling high-dimensional stochastic systems, critical in robotics, autonomous vehicles, and hyperchaotic systems, faces the curse of dimensionality, lacks temporal abstraction, and often fails to ensure stochastic st…

Hierarchical Reinforcement Learning Autonomous Vehicles

Chemical Chain-of-Thought Functions as a Hallucination-Prone Molecular Scratchpad

2026-07-23 · Jiatong Li, Yuxuan Ren, Weida Wang, Xiaoyong Wei 외 arxiv

Chemical reasoning language models are expected to derive molecular answers through faithful chain-of-thought (CoT). However, across four reasoning model families and twelve chemistry tasks, hallucination is widespread a…