paper-with-me

Papers

AsyncTaichi: On-the-fly Inter-kernel Optimizations for Imperative and Spatially Sparse Programming

2020-12-15 · Yuanming Hu, Mingkuan Xu, Ye Kuang, Frédo Durand

Leveraging spatial sparsity has become a popular approach to accelerate 3D computer graphics applications. Spatially sparse data structures and efficient sparse kernels (such as parallel stencil operations on active voxels), are key to achieve high performance. Existing work focuses on improving performance within a single sparse computational kernel. We show that a system that looks beyond a single kernel, plus additional domain-specific sparse data structure analysis, opens up exciting new space for optimizing sparse computations. Specifically, we propose a domain-specific data-flow graph model of imperative and sparse computation programs, which describes kernel relationships and enables easy analysis and optimization. Combined with an asynchronous execution engine that exposes a wide window of kernels, the inter-kernel optimizer can then perform effective sparse computation optimizations, such as eliminating unnecessary voxel list generations and removing voxel activation checks. These domain-specific optimizations further make way for classical general-purpose optimizations that are originally challenging to directly apply to computations with sparse data structures. Without any computational code modification, our new system leads to $4.02\times$ fewer kernel launches and $1.87\times$ speed up on our GPU benchmarks, including computations on Eulerian grids, Lagrangian particles, meshes, and automatic differentiation.

📄 PDF Abstract BibTeX arXiv:2012.08141

Code (0)

등록된 구현이 없습니다.

Tasks

GPU

Similar Papers 제목 키워드 기반

Breaking the Computation and Communication Abstraction Barrier in Distributed Machine Learning Workloads

2021-05-12 · Abhinav Jangda, Jun Huang, Guodong Liu, Amir Hossein Nodehi Sabet 외

Recent trend towards increasing large machine learning models require both training and inference tasks to be distributed. Considering the huge cost of training these models, it is imperative to unlock optimizations in c…

BIG-bench Machine Learning

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels

2026-04-16 · Yifan Zhao, Yuchen Yang, Matei Budiu, Sasa Misailovic arxiv

We present Nautilus, a novel tensor compiler that moves toward fully automated math-to-kernel optimization. Nautilus compiles a high-level algebraic specification of tensor operators into efficient tiled GPU kernels. Nau…

TensorFlow Eager: A Multi-Stage, Python-Embedded DSL for Machine Learning

2019-02-27 · Akshay Agrawal, Akshay Naresh Modi, Alexandre Passos, Allen Lavoie 외

TensorFlow Eager is a multi-stage, Python-embedded domain-specific language for hardware-accelerated machine learning, suitable for both interactive research and production. TensorFlow, which TensorFlow Eager extends, re…

BIG-bench Machine Learning

Cortex: A Compiler for Recursive Deep Learning Models

2020-11-02 · Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

Optimizing deep learning models is generally performed in two steps: (i) high-level graph optimizations such as kernel fusion and (ii) low level kernel optimizations such as those found in vendor libraries. This approach…

Deep Learning

Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolution

2021-08-11 · ICCV 2021 10 · Jingyun Liang, Guolei Sun, Kai Zhang, Luc van Gool 외

Existing blind image super-resolution (SR) methods mostly assume blur kernels are spatially invariant across the whole image. However, such an assumption is rarely applicable for real images whose blur kernels are usuall…

Image Super-ResolutionSuper-Resolution