RHNAS: Realizable Hardware and Neural Architecture Search
The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges. To enable joint optimization of this vast space, there has been growing interest in differentiable NN-HW co-design. Fully differentiable co-design has reduced the resource requirements for discovering optimized NN-HW configurations, but fail to adapt to general hardware accelerator search spaces. This is due to the existence of non-synthesizable (invalid) designs in the search space of many hardware accelerators. To enable efficient and realizable co-design of configurable hardware accelerators with arbitrary neural network search spaces, we introduce RHNAS. RHNAS is a method that combines reinforcement learning for hardware optimization with differentiable neural architecture search. RHNAS discovers realizable NN-HW designs with 1.84x lower latency and 1.86x lower energy-delay product (EDP) on ImageNet and 2.81x lower latency and 3.30x lower EDP on CIFAR-10 over the default hardware accelerator design.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchSimilar Papers 제목 키워드 기반
Tri-Hybrid Multi-User Precoding Based on Electromagnetically Reconfigurable Antennas
The tri-hybrid precoding architecture based on electromagnetically reconfigurable antennas (ERAs) is a promising solution for overcoming key limitations in multiple-input multiple-output communication systems. Aiming to …
VRA: Grounding Discrete-Time Joint Acceleration in Voltage-Constrained Actuation
Discrete-time joint acceleration constraints are widely used to enforce position and velocity limits. However, under voltage-constrained electric actuators, kinematically admissible accelerations may be physically unreal…
Controllable Quantum Memory Capacity in Quantum Reservoir Networks with Tunable partial-SWAPs
In the field of quantum reservoir computing (QRC), many different computational models and architectures have been proposed. From these models, we identify feedback-based models -- which use a feedback mechanism to re-em…
Rethinking Co-design of Neural Architectures and Hardware Accelerators
Neural architectures and hardware accelerators have been two driving forces for the progress in deep learning. Previous works typically attempt to optimize hardware given a fixed model architecture or model architecture …
Neural Architecture SearchHardware/Software Co-Exploration of Neural Architectures
We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural a…
Neural Architecture SearchReinforcement Learning