Squirrel: A Switching Hyperparameter Optimizer
In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated "alliteration nicknames", consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel.
Code (1)
Tasks
AutoMLSimilar Papers 제목 키워드 기반
IntrusionX: A Hybrid Convolutional-LSTM Deep Learning Framework with Squirrel Search Optimization for Network Intrusion Detection
Intrusion Detection Systems (IDS) face persistent challenges due to evolving cyberattacks, high-dimensional traffic data, and severe class imbalance in benchmark datasets such as NSL-KDD. To address these issues, we prop…
Network Intrusion DetectionComputational EfficiencyBinary ClassificationA discrete model for the growth and spread of the Scottish populations of red squirrels (Sciurus vulgaris) and grey squirrels (Sciurus carolinensis)
In this article, a model, discrete in space and time, is developed to describe the growth and spread of the Scottish populations of red squirrels (Sciurus vulgaris) and grey squirrel (Sciurus carolinensis). The initial s…
Analysis of an Induction Machine Fed by a Space Vector Modulated VSI
This paper describes the analysis and simulation performed on a three phase squirrel cage induction motor, fed by a Voltage Source Inverter (VSI), modulated using the space vector modulation scheme. The study mainly focu…
Optimizer Benchmarking Needs to Account for Hyperparameter Tuning
The performance of optimizers, particularly in deep learning, depends considerably on their chosen hyperparameter configuration. The efficacy of optimizers is often studied under near-optimal problem-specific hyperparame…
BenchmarkingOn Empirical Comparisons of Optimizers for Deep Learning
Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that…
BenchmarkingDeep Learning