paper-with-me

Papers

Shisha: Online scheduling of CNN pipelines on heterogeneous architectures

2022-02-23 · Pirah Noor Soomro, Mustafa Abduljabbar, Jeronimo Castrillon, Miquel Pericàs

Chiplets have become a common methodology in modern chip design. Chiplets improve yield and enable heterogeneity at the level of cores, memory subsystem and the interconnect. Convolutional Neural Networks (CNNs) have high computational, bandwidth and memory capacity requirements owing to the increasingly large amount of weights. Thus to exploit chiplet-based architectures, CNNs must be optimized in terms of scheduling and workload distribution among computing resources. We propose Shisha, an online approach to generate and schedule parallel CNN pipelines on chiplet architectures. Shisha targets heterogeneity in compute performance and memory bandwidth and tunes the pipeline schedule through a fast online exploration technique. We compare Shisha with Simulated Annealing, Hill Climbing and Pipe-Search. On average, the convergence time is improved by ~35x in Shisha compared to other exploration algorithms. Despite the quick exploration, Shisha's solution is often better than that of other heuristic exploration algorithms.

📄 PDF Abstract BibTeX arXiv:2202.11575

Code (0)

등록된 구현이 없습니다.

Tasks

Scheduling

Similar Papers 제목 키워드 기반

Tessera: Unlocking Heterogeneous GPUs through Kernel-Granularity Disaggregation

2026-04-11 · Tiancheng Hu, Jin Qin, Zheng Wang, Junhao Hu 외 arxiv

Disaggregation maps parts of an AI workload to different types of GPUs, offering a path to utilize modern heterogeneous GPU clusters. However, existing solutions operate at a coarse granularity and are tightly coupled to…

Patchwork: A Unified Framework for RAG Serving

2025-05-01 · Bodun Hu, Luis Pabon, Saurabh Agarwal, Aditya Akella

Retrieval Augmented Generation (RAG) has emerged as a new paradigm for enhancing Large Language Model reliability through integration with external knowledge sources. However, efficient deployment of these systems presen…

Language ModelingLanguage ModellingLarge Language ModelRAG+2

Speed-Oblivious Online Scheduling: Knowing (Precise) Speeds is not Necessary

2023-02-02 · Alexander Lindermayr, Nicole Megow, Martin Rapp

We consider online scheduling on unrelated (heterogeneous) machines in a speed-oblivious setting, where an algorithm is unaware of the exact job-dependent processing speeds. We show strong impossibility results for clair…

Scheduling

Exploring the Dynamic Scheduling Space of Real-Time Generative AI Applications on Emerging Heterogeneous Systems

2025-07-19 · Rachid Karami, Rajeev Patwari, Hyoukjun Kwon, Ashish Sirasao arxiv

The integration of generative AI models, particularly large language models (LLMs), into real-time multi-model AI applications such as video conferencing and gaming is giving rise to a new class of workloads: real-time g…

JigsawRL: Assembling RL Pipelines for Efficient LLM Post-Training

2026-04-26 · Zhengding Hu, Hehua Ouyang, Chang Chen, Zaifeng Pan 외 arxiv

We present JigsawRL, a cost-efficient framework that explores Pipeline Multiplexing as a new dimension of RL parallelism. JigsawRL decomposes each pipeline into a Sub-Stage Graph that exposes the intra-stage and inter-wo…