paper-with-me

홈 › Papers

Spectrum-Diverse Neuroevolution with Unified Neural Models

2019-01-06 · Danilo Vasconcellos Vargas, Junichi Murata

Learning algorithms are being increasingly adopted in various applications. However, further expansion will require methods that work more automatically. To enable this level of automation, a more powerful solution representation is needed. However, by increasing the representation complexity a second problem arises. The search space becomes huge and therefore an associated scalable and efficient searching algorithm is also required. To solve both problems, first a powerful representation is proposed that unifies most of the neural networks features from the literature into one representation. Secondly, a new diversity preserving method called Spectrum Diversity is created based on the new concept of chromosome spectrum that creates a spectrum out of the characteristics and frequency of alleles in a chromosome. The combination of Spectrum Diversity with a unified neuron representation enables the algorithm to either surpass or equal NeuroEvolution of Augmenting Topologies (NEAT) on all of the five classes of problems tested. Ablation tests justifies the good results, showing the importance of added new features in the unified neuron representation. Part of the success is attributed to the novelty-focused evolution and good scalability with chromosome size provided by Spectrum Diversity. Thus, this study sheds light on a new representation and diversity preserving mechanism that should impact algorithms and applications to come. To download the code please access the following https://github.com/zweifel/Physis-Shard.

📄 PDF Abstract BibTeX arXiv:1902.06703

Code (1)

zweifel/Physis-Shard 공식 구현

Tasks

Diversity

Similar Papers 제목 키워드 기반

Tensorized NeuroEvolution of Augmenting Topologies for GPU Acceleration

2024-04-02 · Lishuang Wang, Mengfei Zhao, Enyu Liu, Kebin Sun 외

The NeuroEvolution of Augmenting Topologies (NEAT) algorithm has received considerable recognition in the field of neuroevolution. Its effectiveness is derived from initiating with simple networks and incrementally evolv…

Computational EfficiencyGPU

AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection framework

2024-03-25 · Marcin Pietroń, Dominik Żurek, Kamil Faber, Roberto Corizzo

Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model opti…

Anomaly DetectionModel Optimization

Neuroevolution of Physics-Informed Neural Nets: Benchmark Problems and Comparative Results

2022-12-15 · Nicholas Sung Wei Yong, Jian Cheng Wong, Pao-Hsiung Chiu, Abhishek Gupta 외

The potential of learned models for fundamental scientific research and discovery is drawing increasing attention worldwide. Physics-informed neural networks (PINNs), where the loss function directly embeds governing equ…

Evolutionary Algorithms

Can Transfer Neuroevolution Tractably Solve Your Differential Equations?

2021-01-06 · Jian Cheng Wong, Abhishek Gupta, Yew-Soon Ong

This paper introduces neuroevolution for solving differential equations. The solution is obtained through optimizing a deep neural network whose loss function is defined by the residual terms from the differential equati…

Seq103: A Unified Neuroevolution Framework for Compact Sequence Architecture Discovery

2026-06-03 · Wenxiao Li, Yongjian Liu, Qing Xie arxiv

Neuroevolution is a representative neural architecture search paradigm that evolves both network topology and weights through evolutionary algorithms. In this paper, we propose Seq103, a unified NEAT-style neuroevolution…

Neural Architecture SearchText Classification