paper-with-me

홈 › Papers

Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems

2025-07-02 · Benjamin Chen Ming Choong, Tao Luo, Cheng Liu, Bingsheng He, Wei Zhang, Joey Tianyi Zhou arxiv

Deep neural networks generate and process large volumes of data, posing challenges for low-resource embedded systems. In-memory computing has been demonstrated as an efficient computing infrastructure and shows promise for embedded AI applications. Among newly-researched memory technologies, racetrack memory is a non-volatile technology that allows high data density fabrication, making it a good fit for in-memory computing. However, integrating in-memory arithmetic circuits with memory cells affects both the memory density and power efficiency. It remains challenging to build efficient in-memory arithmetic circuits on racetrack memory within area and energy constraints. To this end, we present an efficient in-memory convolutional neural network (CNN) accelerator optimized for use with racetrack memory. We design a series of fundamental arithmetic circuits as in-memory computing cells suited for multiply-and-accumulate operations. Moreover, we explore the design space of racetrack memory based systems and CNN model architectures, employing co-design to improve the efficiency and performance of performing CNN inference in racetrack memory while maintaining model accuracy. Our designed circuits and model-system co-optimization strategies achieve a small memory bank area with significant improvements in energy and performance for racetrack memory based embedded systems.

📄 PDF Abstract BibTeX arXiv:2507.01429

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Full-Stack Optimization for CAM-Only DNN Inference

2024-01-23 · João Paulo C. de Lima, Asif Ali Khan, Luigi Carro, Jeronimo Castrillon

The accuracy of neural networks has greatly improved across various domains over the past years. Their ever-increasing complexity, however, leads to prohibitively high energy demands and latency in von Neumann systems. S…

Sustainable AI Processing at the Edge

2022-07-04 · Sébastien Ollivier, Sheng Li, Yue Tang, Chayanika Chaudhuri 외

Edge computing is a popular target for accelerating machine learning algorithms supporting mobile devices without requiring the communication latencies to handle them in the cloud. Edge deployments of machine learning pr…

BIG-bench Machine LearningEdge-computingGPU

Brain-inspired Cognition in Next Generation Racetrack Memories

2021-11-03 · Asif Ali Khan, Sebastien Ollivier, Stephen Longofono, Gerald Hempel 외

Hyperdimensional computing (HDC) is an emerging computational framework inspired by the brain that operates on vectors with thousands of dimensions to emulate cognition. Unlike conventional computational frameworks that …

One-Shot Learning

MICSim: A Modular Simulator for Mixed-signal Compute-in-Memory based AI Accelerator

2024-09-23 · Cong Wang, Zeming Chen, Shanshi Huang

This work introduces MICSim, an open-source, pre-circuit simulator designed for early-stage evaluation of chip-level software performance and hardware overhead of mixed-signal compute-in-memory (CIM) accelerators. MICSim…

Quantization

LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

2026-02-26 · Jaehong Cho, Hyunmin Choi, Guseul Heo, Jongse Park arxiv

Large language model (LLM) serving infrastructures are undergoing a shift toward heterogeneity and disaggregation. Modern deployments increasingly integrate diverse accelerators and near-memory processing technologies, i…