A Computing Kernel for Network Binarization on PyTorch

2019-11-11 · Xianda Xu, Marco Pedersoli

Deep Neural Networks have now achieved state-of-the-art results in a wide range of tasks including image classification, object detection and so on. However, they are both computation consuming and memory intensive, making them difficult to deploy on low-power devices. Network binarization is one of the existing effective techniques for model compression and acceleration, but there is no computing kernel yet to support it on PyTorch. In this paper we developed a computing kernel supporting 1-bit xnor and bitcount computation on PyTorch. Experimental results show that our kernel could accelerate the inference of the binarized neural network by 3 times in GPU and by 4.5 times in CPU compared with the control group.

📄 PDF Abstract BibTeX arXiv:1911.04477

Code (1)

brycexu/BNN_Kernel 공식 구현 pytorch

Tasks

BinarizationCPUGPUimage-classification Image Classification Model Compression object-detection Object Detection

Efficient Neural Network Deployment for Microcontroller

2020-07-02 · Hasan Unlu

Edge computing for neural networks is getting important especially for low power applications and offline devices. TensorFlow Lite and PyTorch Mobile were released for this purpose. But they mainly support mobile devices…

Binarization Edge-computing Efficient Neural Network

NNGeometry: Easy and Fast Fisher Information Matrices and Neural Tangent Kernels in PyTorch

2021-01-01 · Thomas George

Fisher Information Matrices (FIM) and Neural Tangent Kernels (NTK) are useful tools in a number of diverse applications related to neural networks. Yet these theoretical tools are often difficult to implement using curre…

SoftDTW-CUDA-Torch: Memory-Efficient GPU-Accelerated Soft Dynamic Time Warping for PyTorch

2026-02-19 · Ron Shapira Weber, Oren Freifeld arxiv

We present softdtw-cuda-torch, an open-source PyTorch library for computing Soft Dynamic Time Warping (SoftDTW) on GPUs. Our implementation addresses three key limitations of existing GPU implementations of SoftDTW: a ha…

Astra: A Multi-Agent System for GPU Kernel Performance Optimization

2025-09-09 · Anjiang Wei, Tianran Sun, Yogesh Seenichamy, Hang Song 외 arxiv

GPU kernel optimization has long been a central challenge at the intersection of high-performance computing and machine learning. Efficient kernels are crucial for accelerating large language model (LLM) training and ser…

Code Generation

DRTriton: Large-Scale Synthetic Data Driven Reinforcement Learning for Triton Kernel Generation

2026-03-23 · Siqi Guo, Ming Lin, Tianbao Yang arxiv

Developing efficient CUDA kernels is a fundamental yet challenging task in the generative AI industry. Recent research leverages Large Language Models (LLMs) to automatically convert PyTorch reference implementations to …

Reinforcement Learning