paper-with-me

Papers

LLM-POET: Evolving Complex Environments using Large Language Models

2024-06-07 · Fuma Aki, Riku Ikeda, Takumi Saito, Ciaran Regan, Mizuki Oka

Creating systems capable of generating virtually infinite variations of complex and novel behaviour without predetermined goals or limits is a major challenge in the field of AI. This challenge has been addressed through the development of several open-ended algorithms that can continuously generate new and diverse behaviours, such as the POET and Enhanced-POET algorithms for co-evolving environments and agent behaviour. One of the challenges with existing methods however, is that they struggle to continuously generate complex environments. In this work, we propose LLM-POET, a modification of the POET algorithm where the environment is both created and mutated using a Large Language Model (LLM). By fine-tuning a LLM with text representations of Evolution Gym environments and captions that describe the environment, we were able to generate complex and diverse environments using natural language. We found that not only could the LLM produce a diverse range of environments, but compared to the CPPNs used in Enhanced-POET for environment generation, the LLM allowed for a 34% increase in the performance gain of co-evolution. This increased performance suggests that the agents were able to learn a more diverse set of skills by training on more complex environments.

📄 PDF Abstract BibTeX arXiv:2406.04663

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Co-optimising Robot Morphology and Controller in a Simulated Open-Ended Environment

2021-04-07 · Emma Hjellbrekke Stensby, Kai Olav Ellefsen, Kyrre Glette

Designing robots by hand can be costly and time consuming, especially if the robots have to be created with novel materials, or be robust to internal or external changes. In order to create robots automatically, without …

Diversity

Don’t Go Far Off: An Empirical Study on Neural Poetry Translation

2021-11-01 · EMNLP 2021 11 · Tuhin Chakrabarty, Arkadiy Saakyan, Smaranda Muresan

Despite constant improvements in machine translation quality, automatic poetry translation remains a challenging problem due to the lack of open-sourced parallel poetic corpora, and to the intrinsic complexities involved…

Machine TranslationTranslation

LLM-based multi-agent poetry generation in non-cooperative environments

2024-09-05 · Ran Zhang, Steffen Eger

Despite substantial progress of large language models (LLMs) for automatic poetry generation, the generated poetry lacks diversity while the training process differs greatly from human learning. Under the rationale that …

Diversity

Don't Go Far Off: An Empirical Study on Neural Poetry Translation

2021-09-07 · Tuhin Chakrabarty, Arkadiy Saakyan, Smaranda Muresan

Despite constant improvements in machine translation quality, automatic poetry translation remains a challenging problem due to the lack of open-sourced parallel poetic corpora, and to the intrinsic complexities involved…

Machine TranslationTranslation

Reasoning Like Program Executors

2022-01-27 · Xinyu Pi, Qian Liu, Bei Chen, Morteza Ziyadi 외

Reasoning over natural language is a long-standing goal for the research community. However, studies have shown that existing language models are inadequate in reasoning. To address the issue, we present POET, a novel re…

Logical ReasoningMathQuestion Answering