paper-with-me

Papers

Data-efficient Learning of Morphology and Controller for a Microrobot

2019-05-03 · Thomas Liao, Grant Wang, Brian Yang, Rene Lee, Kristofer Pister, Sergey Levine, Roberto Calandra

Robot design is often a slow and difficult process requiring the iterative construction and testing of prototypes, with the goal of sequentially optimizing the design. For most robots, this process is further complicated by the need, when validating the capabilities of the hardware to solve the desired task, to already have an appropriate controller, which is in turn designed and tuned for the specific hardware. In this paper, we propose a novel approach, HPC-BBO, to efficiently and automatically design hardware configurations, and evaluate them by also automatically tuning the corresponding controller. HPC-BBO is based on a hierarchical Bayesian optimization process which iteratively optimizes morphology configurations (based on the performance of the previous designs during the controller learning process) and subsequently learns the corresponding controllers (exploiting the knowledge collected from optimizing for previous morphologies). Moreover, HPC-BBO can select a "batch" of multiple morphology designs at once, thus parallelizing hardware validation and reducing the number of time-consuming production cycles. We validate HPC-BBO on the design of the morphology and controller for a simulated 6-legged microrobot. Experimental results show that HPC-BBO outperforms multiple competitive baselines, and yields a $360\%$ reduction in production cycles over standard Bayesian optimization, thus reducing the hypothetical manufacturing time of our microrobot from 21 to 4 months.

📄 PDF Abstract BibTeX arXiv:1905.01334

Code (1)

tholiao/learning-morph-and-ctrl

Tasks

Bayesian Optimization

Similar Papers 제목 키워드 기반

Microrobot Vascular Parkour: Analytic Geometry-based Path Planning with Real-time Dynamic Obstacle Avoidance

2025-09-05 · Yanda Yang, Max Sokolich, Fatma Ceren Kirmizitas, Sambeeta Das 외 arxiv

Autonomous microrobots in blood vessels could enable minimally invasive therapies, but navigation is challenged by dense, moving obstacles. We propose a real-time path planning framework that couples an analytic geometry…

Reinforcement Learning

Smart Magnetic Microrobots Learn to Swim with Deep Reinforcement Learning

2022-01-14 · Michael R. Behrens, Warren C. Ruder

Swimming microrobots are increasingly developed with complex materials and dynamic shapes and are expected to operate in complex environments in which the system dynamics are difficult to model and positional control of …

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Modeling and Control of Magnetic Forces between Microrobots

2025-11-19 · Amelia Fernández Seguel, Alejandro I. Maass arxiv

The independent control of multiple magnetic microrobots under a shared global signal presents critical challenges in biomedical applications such as targeted drug delivery and microsurgeries. Most existing systems only …

Residual Model Learning for Microrobot Control

2021-04-01 · Joshua Gruenstein, Tao Chen, Neel Doshi, Pulkit Agrawal

A majority of microrobots are constructed using compliant materials that are difficult to model analytically, limiting the utility of traditional model-based controllers. Challenges in data collection on microrobots and …

model

Control of Microrobots with Reinforcement Learning under On-Device Compute Constraints

2025-12-31 · Yichen Liu, Kesava Viswanadha, Zhongyu Li, Nelson Lojo 외 arxiv

An important function of autonomous microrobots is the ability to perform robust movement over terrain. This paper explores an edge ML approach to microrobot locomotion, allowing for on-device, lower latency control unde…

Reinforcement Learning