paper-with-me

홈 › Papers

A Survey of Near-Data Processing Architectures for Neural Networks

2021-12-23 · Mehdi Hassanpour, Marc Riera, Antonio González

Data-intensive workloads and applications, such as machine learning (ML), are fundamentally limited by traditional computing systems based on the von-Neumann architecture. As data movement operations and energy consumption become key bottlenecks in the design of computing systems, the interest in unconventional approaches such as Near-Data Processing (NDP), machine learning, and especially neural network (NN)-based accelerators has grown significantly. Emerging memory technologies, such as ReRAM and 3D-stacked, are promising for efficiently architecting NDP-based accelerators for NN due to their capabilities to work as both: High-density/low-energy storage and in/near-memory computation/search engine. In this paper, we present a survey of techniques for designing NDP architectures for NN. By classifying the techniques based on the memory technology employed, we underscore their similarities and differences. Finally, we discuss open challenges and future perspectives that need to be explored in order to improve and extend the adoption of NDP architectures for future computing platforms. This paper will be valuable for computer architects, chip designers and researchers in the area of machine learning.

📄 PDF Abstract BibTeX arXiv:2112.12630

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningSurvey

Similar Papers 제목 키워드 기반

From S4 to Mamba: A Comprehensive Survey on Structured State Space Models

2025-03-22 · Shriyank Somvanshi, Md Monzurul Islam, Mahmuda Sultana Mimi, Sazzad Bin Bashar Polock 외

Recent advancements in sequence modeling have led to the emergence of Structured State Space Models (SSMs) as an efficient alternative to Recurrent Neural Networks (RNNs) and Transformers, addressing challenges in long-r…

Computational EfficiencyMambaspeech-recognitionSpeech Recognition+3

Learning-Driven Lossy Image Compression; A Comprehensive Survey

2022-01-23 · Sonain Jamil, Md. Jalil Piran, MuhibUrRahman

In the realm of image processing and computer vision (CV), machine learning (ML) architectures are widely applied. Convolutional neural networks (CNNs) solve a wide range of image processing issues and can solve image co…

CPUGPUImage CompressionSurvey

A Survey of the Usages of Deep Learning in Natural Language Processing

2018-07-27 · Daniel W. Otter, Julian R. Medina, Jugal K. Kalita

Over the last several years, the field of natural language processing has been propelled forward by an explosion in the use of deep learning models. This survey provides a brief introduction to the field and a quick over…

Deep Learning

Pretrained Transformers for Text Ranking: BERT and Beyond

2020-10-13 · NAACL 2021 4 · Jimmy Lin, Rodrigo Nogueira, Andrew Yates

The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in response to a query. Although the most common formulation of text ranking is search, instances of the task can also be found in …

Information RetrievalRerankingRetrievalSentence+1

A survey of the Vision Transformers and their CNN-Transformer based Variants

2023-05-17 · Asifullah Khan, Zunaira Rauf, Anabia Sohail, Abdul Rehman 외

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationsh…

Survey