Faster Convolution Inference Through Using Pre-Calculated Lookup Tables
Low-cardinality activations permit an algorithm based on fetching the inference values from pre-calculated lookup tables instead of calculating them every time. This algorithm can have extensions, some of which offer abilities beyond those of the currently used algorithms. It also allows for a simpler and more effective CNN-specialized hardware.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Lookup Network
Convolutional neural networks are constructed with massive operations with different types and are highly computationally intensive. Among these operations, multiplication operation is higher in computational complexity …
Point Cloud ClassificationImage Super-ResolutionImage ClassificationPoint CloudsFast Matrix Multiplications for Lookup Table-Quantized LLMs
The deployment of large language models (LLMs) is often constrained by memory bandwidth, where the primary bottleneck is the cost of transferring model parameters from the GPU's global memory to its registers. When coupl…
QuantizationDnLUT: Ultra-Efficient Color Image Denoising via Channel-Aware Lookup Tables
While deep neural networks have revolutionized image denoising capabilities, their deployment on edge devices remains challenging due to substantial computational and memory requirements. To this end, we present DnLUT, a…
Color Image DenoisingDenoisingImage DenoisingTaming Lookup Tables for Efficient Image Retouching
The widespread use of high-definition screens in edge devices, such as end-user cameras, smartphones, and televisions, is spurring a significant demand for image enhancement. Existing enhancement models often optimize fo…
CPUGPUImage EnhancementImage RetouchingVec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices
Large language models (LLMs) are increasingly deployed on edge devices. To meet strict resource constraints, real-world deployment has pushed LLM quantization from 8-bit to 4-bit, 2-bit, and now 1.58-bit. Combined with l…