Training microrobots to swim by a large language model
Machine learning and artificial intelligence have recently represented a popular paradigm for designing and optimizing robotic systems across various scales. Recent studies have showcased the innovative application of large language models (LLMs) in industrial control [1] and in directing legged walking robots [2]. In this study, we utilize an LLM, GPT-4, to train two prototypical microrobots for swimming in viscous fluids. Adopting a few-shot learning approach, we develop a minimal, unified prompt composed of only five sentences. The same concise prompt successfully guides two distinct articulated microrobots -- the three-link swimmer and the three-sphere swimmer -- in mastering their signature strokes. These strokes, initially conceptualized by physicists, are now effectively interpreted and applied by the LLM, enabling the microrobots to circumvent the physical constraints inherent to micro-locomotion. Remarkably, our LLM-based decision-making strategy substantially surpasses a traditional reinforcement learning method in terms of training speed. We discuss the nuanced aspects of prompt design, particularly emphasizing the reduction of monetary expenses of using GPT-4.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingFew-Shot LearningLanguage ModelingLanguage ModellingLarge Language ModelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Smart Magnetic Microrobots Learn to Swim with Deep Reinforcement Learning
Swimming microrobots are increasingly developed with complex materials and dynamic shapes and are expected to operate in complex environments in which the system dynamics are difficult to model and positional control of …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Chemotaxis of sea urchin sperm cells through deep reinforcement learning
By imitating biological microswimmers, microrobots can be designed to accomplish targeted delivery of cargos and biomedical manipulations at microscale. However, it is still a great challenge to enable microrobots to man…
Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1Membrane-based Acoustic Microrobots
Acoustic microrobots have emerged as a promising frontier for targeted drug delivery and minimally invasive medicine due to their high-power density and biocompatibility. Despite wide-ranging designs, conventional acoust…
Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval
There has been limited success for dense retrieval models in multilingual retrieval, due to uneven and scarce training data available across multiple languages. Synthetic training data generation is promising (e.g., InPa…
Language ModelingLanguage ModellingLarge Language ModelRetrievalAutonomous object harvesting using synchronized optoelectronic microrobots
Optoelectronic tweezer-driven microrobots (OETdMs) are a versatile micromanipulation technology based on the use of light induced dielectrophoresis to move small dielectric structures (microrobots) across a photoconducti…
Cultural Vocal Bursts Intensity PredictionObject