paper-with-me

Papers

Genetic Algorithm based hyper-parameters optimization for transfer Convolutional Neural Network

2021-02-26 · Chen Li, JinZhe Jiang, YaQian Zhao, RenGang Li, EnDong Wang, Xin Zhang, Kun Zhao

Hyperparameter optimization is a challenging problem in developing deep neural networks. Decision of transfer layers and trainable layers is a major task for design of the transfer convolutional neural networks (CNN). Conventional transfer CNN models are usually manually designed based on intuition. In this paper, a genetic algorithm is applied to select trainable layers of the transfer model. The filter criterion is constructed by accuracy and the counts of the trainable layers. The results show that the method is competent in this task. The system will converge with a precision of 97% in the classification of Cats and Dogs datasets, in no more than 15 generations. Moreover, backward inference according the results of the genetic algorithm shows that our method can capture the gradient features in network layers, which plays a part on understanding of the transfer AI models.

📄 PDF Abstract BibTeX arXiv:2103.03875

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter Optimization

Similar Papers 제목 키워드 기반

Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic Algorithm

2020-06-23 · Xueli Xiao, Ming Yan, Sunitha Basodi, Chunyan Ji 외

Convolutional Neural Networks (CNN) have gained great success in many artificial intelligence tasks. However, finding a good set of hyperparameters for a CNN remains a challenging task. It usually takes an expert with de…

CPUHyperparameter Optimization

Deep Genetic Network

2018-11-05 · Siddhartha Dhar Choudhury, Shashank Pandey, Kunal Mehrotra

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into …

Hyperparameter Optimization

Genetic CFL: Optimization of Hyper-Parameters in Clustered Federated Learning

2021-07-15 · Shaashwat Agrawal, Sagnik Sarkar, Mamoun Alazab, Praveen Kumar Reddy Maddikunta 외

Federated learning (FL) is a distributed model for deep learning that integrates client-server architecture, edge computing, and real-time intelligence. FL has the capability of revolutionizing machine learning (ML) but …

Edge-computingFederated Learning

The DNA of Calabi-Yau Hypersurfaces

2024-05-14 · Nate MacFadden, Andreas Schachner, Elijah Sheridan

We implement Genetic Algorithms for triangulations of four-dimensional reflexive polytopes which induce Calabi-Yau threefold hypersurfaces via Batryev's construction. We demonstrate that such algorithms efficiently optim…

Bayesian Optimization

A Study of Genetic Algorithms for Hyperparameter Optimization of Neural Networks in Machine Translation

2020-09-15 · Keshav Ganapathy

With neural networks having demonstrated their versatility and benefits, the need for their optimal performance is as prevalent as ever. A defining characteristic, hyperparameters, can greatly affect its performance. Thu…

Hyperparameter OptimizationMachine TranslationTranslation