paper-with-me

Papers

Intrinsically Motivated Discovery of Diverse Patterns in Self-Organizing Systems

2019-08-19 · ICLR 2020 1 · Chris Reinke, Mayalen Etcheverry, Pierre-Yves Oudeyer

In many complex dynamical systems, artificial or natural, one can observe self-organization of patterns emerging from local rules. Cellular automata, like the Game of Life (GOL), have been widely used as abstract models enabling the study of various aspects of self-organization and morphogenesis, such as the emergence of spatially localized patterns. However, findings of self-organized patterns in such models have so far relied on manual tuning of parameters and initial states, and on the human eye to identify interesting patterns. In this paper, we formulate the problem of automated discovery of diverse self-organized patterns in such high-dimensional complex dynamical systems, as well as a framework for experimentation and evaluation. Using a continuous GOL as a testbed, we show that recent intrinsically-motivated machine learning algorithms (POP-IMGEPs), initially developed for learning of inverse models in robotics, can be transposed and used in this novel application area. These algorithms combine intrinsically-motivated goal exploration and unsupervised learning of goal space representations. Goal space representations describe the interesting features of patterns for which diverse variations should be discovered. In particular, we compare various approaches to define and learn goal space representations from the perspective of discovering diverse spatially localized patterns. Moreover, we introduce an extension of a state-of-the-art POP-IMGEP algorithm which incrementally learns a goal representation using a deep auto-encoder, and the use of CPPN primitives for generating initialization parameters. We show that it is more efficient than several baselines and equally efficient as a system pre-trained on a hand-made database of patterns identified by human experts.

📄 PDF Abstract BibTeX arXiv:1908.06663

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning

2017-08-07 · Sébastien Forestier, Rémy Portelas, Yoan Mollard, Pierre-Yves Oudeyer

Intrinsically motivated spontaneous exploration is a key enabler of autonomous developmental learning in human children. It enables the discovery of skill repertoires through autotelic learning, i.e. the self-generation,…

Developmental LearningMulti-Goal Reinforcement LearningReinforcement LearningSelf-Supervised Learning

Exploring Flow-Lenia Universes with a Curiosity-driven AI Scientist: Discovering Diverse Ecosystem Dynamics

2025-05-21 · Thomas Michel, Marko Cvjetko, Gautier Hamon, Pierre-Yves Oudeyer 외

We present a method for the automated discovery of system-level dynamics in Flow-Lenia$-$a continuous cellular automaton (CA) with mass conservation and parameter localization$-$using a curiosity-driven AI scientist. Thi…

Hierarchically Organized Latent Modules for Exploratory Search in Morphogenetic Systems

2020-07-02 · NeurIPS 2020 12 · Mayalen Etcheverry, Clement Moulin-Frier, Pierre-Yves Oudeyer

Self-organization of complex morphological patterns from local interactions is a fascinating phenomenon in many natural and artificial systems. In the artificial world, typical examples of such morphogenetic systems are …

DiversityEfficient ExplorationRepresentation Learning

Progressive growing of self-organized hierarchical representations for exploration

2020-05-13 · Mayalen Etcheverry, Pierre-Yves Oudeyer, Chris Reinke

Designing agent that can autonomously discover and learn a diversity of structures and skills in unknown changing environments is key for lifelong machine learning. A central challenge is how to learn incrementally repre…

DiversityRepresentation Learning

Meta-Diversity Search in Complex Systems, A Recipe for Artificial Open-Endedness ?

2023-12-01 · Mayalen Etcheverry, Bert Wang-Chak Chan, Clément Moulin-Frier, Pierre-Yves Oudeyer

Can we build an artificial system that would be able to generate endless surprises if ran "forever" in Minecraft? While there is not a single path toward solving that grand challenge, this article presents what we believ…

DiversityMinecraft