paper-with-me

Papers

Training microrobots to swim by a large language model

2024-01-21 · Zhuoqun Xu, Lailai Zhu

Machine learning and artificial intelligence have recently represented a popular paradigm for designing and optimizing robotic systems across various scales. Recent studies have showcased the innovative application of large language models (LLMs) in industrial control [1] and in directing legged walking robots [2]. In this study, we utilize an LLM, GPT-4, to train two prototypical microrobots for swimming in viscous fluids. Adopting a few-shot learning approach, we develop a minimal, unified prompt composed of only five sentences. The same concise prompt successfully guides two distinct articulated microrobots -- the three-link swimmer and the three-sphere swimmer -- in mastering their signature strokes. These strokes, initially conceptualized by physicists, are now effectively interpreted and applied by the LLM, enabling the microrobots to circumvent the physical constraints inherent to micro-locomotion. Remarkably, our LLM-based decision-making strategy substantially surpasses a traditional reinforcement learning method in terms of training speed. We discuss the nuanced aspects of prompt design, particularly emphasizing the reduction of monetary expenses of using GPT-4.

📄 PDF Abstract BibTeX arXiv:2402.00044

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFew-Shot LearningLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Smart Magnetic Microrobots Learn to Swim with Deep Reinforcement Learning

2022-01-14 · Michael R. Behrens, Warren C. Ruder

Swimming microrobots are increasingly developed with complex materials and dynamic shapes and are expected to operate in complex environments in which the system dynamics are difficult to model and positional control of …

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Chemotaxis of sea urchin sperm cells through deep reinforcement learning

2022-08-02 · Chaojie Mo, Xin Bian

By imitating biological microswimmers, microrobots can be designed to accomplish targeted delivery of cargos and biomedical manipulations at microscale. However, it is still a great challenge to enable microrobots to man…

Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1

Membrane-based Acoustic Microrobots

2026-06-19 · Fatih Kocabas, Cemal Polat Avdar, Prithvi Venkatesh, Yunus Alapan arxiv

Acoustic microrobots have emerged as a promising frontier for targeted drug delivery and minimally invasive medicine due to their high-power density and biocompatibility. Despite wide-ranging designs, conventional acoust…

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval

2023-11-10 · Nandan Thakur, Jianmo Ni, Gustavo Hernández Ábrego, John Wieting 외

There has been limited success for dense retrieval models in multilingual retrieval, due to uneven and scarce training data available across multiple languages. Synthetic training data generation is promising (e.g., InPa…

Language ModelingLanguage ModellingLarge Language ModelRetrieval

Autonomous object harvesting using synchronized optoelectronic microrobots

2021-03-08 · Christopher Bendkowski, Laurent Mennillo, Tao Xu, Mohamed Elsayed 외

Optoelectronic tweezer-driven microrobots (OETdMs) are a versatile micromanipulation technology based on the use of light induced dielectrophoresis to move small dielectric structures (microrobots) across a photoconducti…

Cultural Vocal Bursts Intensity PredictionObject