paper-with-me

Papers

A Microarchitecture Implementation Framework for Online Learning with Temporal Neural Networks

2021-05-27 · Harideep Nair, John Paul Shen, James E. Smith

Temporal Neural Networks (TNNs) are spiking neural networks that use time as a resource to represent and process information, similar to the mammalian neocortex. In contrast to compute-intensive deep neural networks that employ separate training and inference phases, TNNs are capable of extremely efficient online incremental/continual learning and are excellent candidates for building edge-native sensory processing units. This work proposes a microarchitecture framework for implementing TNNs using standard CMOS. Gate-level implementations of three key building blocks are presented: 1) multi-synapse neurons, 2) multi-neuron columns, and 3) unsupervised and supervised online learning algorithms based on Spike Timing Dependent Plasticity (STDP). The proposed microarchitecture is embodied in a set of characteristic scaling equations for assessing the gate count, area, delay and power for any TNN design. Post-synthesis results (in 45nm CMOS) for the proposed designs are presented, and their online incremental learning capability is demonstrated.

📄 PDF Abstract BibTeX arXiv:2105.13262

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningIncremental Learning

Similar Papers 제목 키워드 기반

Direct CMOS Implementation of Neuromorphic Temporal Neural Networks for Sensory Processing

2020-08-27 · Harideep Nair, John Paul Shen, James E. Smith

Temporal Neural Networks (TNNs) use time as a resource to represent and process information, mimicking the behavior of the mammalian neocortex. This work focuses on implementing TNNs using off-the-shelf digital CMOS tech…

TNN7: A Custom Macro Suite for Implementing Highly Optimized Designs of Neuromorphic TNNs

2022-05-16 · Harideep Nair, Prabhu Vellaisamy, Santha Bhasuthkar, John Paul Shen

Temporal Neural Networks (TNNs), inspired from the mammalian neocortex, exhibit energy-efficient online sensory processing capabilities. Recent works have proposed a microarchitecture framework for implementing TNNs and …

Time SeriesTime Series AnalysisTime Series Clustering

MicroEvo: Knowledge-Guided LLM Sampling for Efficient Microarchitecture Design Space Exploration

2026-08-06 · Jia Xiong, Runkai Li, Chenxu Niu, Guangyuan Gao 외 arxiv

Microarchitecture design space exploration suffers from expansive search spaces and expensive PPA evaluation, leaving only a small simulation budget for design decision-making. Existing methods perform blind search witho…

Selecting Microarchitecture Configuration of Processors for Internet of Things

2018-02-19

The Internet of Things (IoT) makes use of ubiquitous internet connectivity to form a network of everyday physical objects for purposes of automation, remote data sensing and centralized management/control. IoT objects ne…

Management

Tao: Re-Thinking DL-based Microarchitecture Simulation

2024-04-16 · Santosh Pandey, Amir Yazdanbakhsh, Hang Liu

Microarchitecture simulators are indispensable tools for microarchitecture designers to validate, estimate, and optimize new hardware that meets specific design requirements. While the quest for a fast, accurate and deta…

Transfer Learning