paper-with-me

Papers

SALSA: Simulated Annealing based Loop-Ordering Scheduler for DNN Accelerators

2023-04-20 · Victor J. B. Jung, Arne Symons, Linyan Mei, Marian Verhelst, Luca Benini

To meet the growing need for computational power for DNNs, multiple specialized hardware architectures have been proposed. Each DNN layer should be mapped onto the hardware with the most efficient schedule, however, SotA schedulers struggle to consistently provide optimum schedules in a reasonable time across all DNN-HW combinations. This paper proposes SALSA, a fast dual-engine scheduler to generate optimal execution schedules for both even and uneven mapping. We introduce a new strategy, combining exhaustive search with simulated annealing to address the dynamic nature of the loop ordering design space size across layers. SALSA is extensively benchmarked against two SotA schedulers, LOMA and Timeloop on 5 different DNNs, on average SALSA finds schedules with 11.9% and 7.6% lower energy while speeding up the search by 1.7x and 24x compared to LOMA and Timeloop, respectively.

📄 PDF Abstract BibTeX arXiv:2304.12931

Code (1)

ZigZag-Project/zigzag 공식 구현

Similar Papers 제목 키워드 기반

On Class Orderings for Incremental Learning

2020-07-04 · Marc Masana, Bartłomiej Twardowski, Joost Van de Weijer

The influence of class orderings in the evaluation of incremental learning has received very little attention. In this paper, we investigate the impact of class orderings for incrementally learned classifiers. We propose…

Incremental Learning

Cyclical Log Annealing as a Learning Rate Scheduler

2024-03-13 · Philip Naveen

A learning rate scheduler is a predefined set of instructions for varying search stepsizes during model training processes. This paper introduces a new logarithmic method using harsh restarting of step sizes through stoc…

CBM-Dual: A 65-nm Fully Connected Chaotic Boltzmann Machine Processor for Dual Function Simulated Annealing and Reservoir Computing

2026-04-08 · Kanta Yoshioka, Soshi Hirayae, Yuichiro Tanaka, Yuichi Katori 외 arxiv

This paper presents CBM-Dual, the first silicon-proven digital chaotic dynamics processor (CDP) supporting both simulated annealing (SA) and reservoir computing (RC). CBM-Dual enables real-time decision-making and lightw…

A simulated annealing approach to optimal storing in a multi-level warehouse

2017-03-25 · Alexander Eckrot, Carina Geldhauser, Jan Jurczyk

We propose a simulated annealing algorithm specifically tailored to optimise total retrieval times in a multi-level warehouse under complex pre-batched picking constraints. Experiments on real data from a picker-to-parts…

ClusteringRetrieval

AdaAnn: Adaptive Annealing Scheduler for Probability Density Approximation

2022-02-01 · Emma R. Cobian, Jonathan D. Hauenstein, Fang Liu, Daniele E. Schiavazzi

Approximating probability distributions can be a challenging task, particularly when they are supported over regions of high geometrical complexity or exhibit multiple modes. Annealing can be used to facilitate this task…

Computational Efficiencyparameter estimationVariational Inference