paper-with-me

홈 › Papers

Darwin: A DRAM-based Multi-level Processing-in-Memory Architecture for Data Analytics

2023-05-23 · Donghyuk Kim, Jae-Young Kim, Wontak Han, Jongsoon Won, Haerang Choi, Yongkee Kwon, Joo-Young Kim

Processing-in-memory (PIM) architecture is an inherent match for data analytics application, but we observe major challenges to address when accelerating it using PIM. In this paper, we propose Darwin, a practical LRDIMM-based multi-level PIM architecture for data analytics, which fully exploits the internal bandwidth of DRAM using the bank-, bank group-, chip-, and rank-level parallelisms. Considering the properties of data analytics operators and DRAM's area constraints, Darwin maximizes the internal data bandwidth by placing the PIM processing units, buffers, and control circuits across the hierarchy of DRAM. More specifically, it introduces the bank processing unit for each bank in which a single instruction multiple data (SIMD) unit handles regular data analytics operators and bank group processing unit for each bank group to handle workload imbalance in the condition-oriented data analytics operators. Furthermore, Darwin supports a novel PIM instruction architecture that concatenates instructions for multiple thread executions on bank group processing entities, addressing the command bottleneck by enabling separate control of up to 512 different in-memory processing units simultaneously. We build a cycle-accurate simulation framework to evaluate Darwin with various DRAM configurations, optimization schemes and workloads. Darwin achieves up to 14.7x speedup over the non-optimized version. Finally, the proposed Darwin architecture achieves 4.0x-43.9x higher throughput and reduces energy consumption by 85.7% than the baseline CPU system (Intel Xeon Gold 6226 + 4 channels of DDR4-2933). Compared to the state-of-the-art PIM, Darwin achieves up to 7.5x and 7.1x in the basic query operators and TPC-H queries, respectively. Darwin is based on the latest GDDR6 and requires only 5.6% area overhead, suggesting a promising PIM solution for the future main memory system.

📄 PDF Abstract BibTeX arXiv:2305.13970

Code (0)

등록된 구현이 없습니다.

Tasks

CPU

Similar Papers 제목 키워드 기반

Data Darwinism Part I: Unlocking the Value of Scientific Data for Pre-training

2026-02-08 · Yiwei Qin, Zhen Huang, Tiantian Mi, Weiye Si 외 arxiv

Data quality determines foundation model performance, yet systematic processing frameworks are lacking. We introduce Data Darwinism, a ten-level taxonomy (L0-L9) that conceptualizes data-model co-evolution: advanced mode…

PIM-DRAM: Accelerating Machine Learning Workloads using Processing in Commodity DRAM

2021-05-08 · Sourjya Roy, Mustafa Ali, Anand Raghunathan

Deep Neural Networks (DNNs) have transformed the field of machine learning and are widely deployed in many applications involving image, video, speech and natural language processing. The increasing compute demands of DN…

BIG-bench Machine LearningGPUMedical Diagnosis

Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolution

2026-01-30 · Hongze Mi, Yibo Feng, WenJie Lu, Song Cao 외 arxiv

Multimodal Large Language Model (MLLM) agents facilitate Graphical User Interface (GUI) automation but struggle with long-horizon, cross-application tasks due to limited context windows. While memory systems provide a vi…

Darwin3: A large-scale neuromorphic chip with a Novel ISA and On-Chip Learning

2023-12-29 · De Ma, Xiaofei Jin, Shichun Sun, Yitao Li 외

Spiking Neural Networks (SNNs) are gaining increasing attention for their biological plausibility and potential for improved computational efficiency. To match the high spatial-temporal dynamics in SNNs, neuromorphic chi…

Computational Efficiency

Creativity: Linchpin in the Quest for a Viable Theory of Cultural Evolution

2019-03-13

This paper outlines the implications of neural-level accounts of insight, and models of the conceptual interactions that underlie creativity, for a theory of cultural evolution. Since elements of human culture exhibit cu…

Cultural Vocal Bursts Intensity Prediction