paper-with-me

Papers

Approximate DCT and Quantization Techniques for Energy-Constrained Image Sensors

2024-06-24 · Ming-Che Li, Archisman Ghosh, Shreyas Sen

Recent expansions in multimedia devices gather enormous amounts of real-time images for processing and inference. The images are first compressed using compression schemes, like JPEG, to reduce storage costs and power for transmitting the captured data. Due to inherent error resilience and imperceptibility in images, JPEG can be approximated to reduce the required computation power and area. This work demonstrates the first end-to-end approximation computing-based optimization of JPEG hardware using i) an approximate division realized using bit-shift operators to reduce the complexity of the quantization block, ii) loop perforation, and iii) precision scaling on top of a multiplier-less fast DCT architecture to achieve an extremely energy-efficient JPEG compression unit which will be a perfect fit for power/bandwidth-limited scenario. Furthermore, a gradient descent-based heuristic composed of two conventional approximation strategies, i.e., Precision Scaling and Loop Perforation, is implemented for tuning the degree of approximation to trade off energy consumption with the quality degradation of the decoded image. The entire RTL design is coded in Verilog HDL, synthesized, mapped to TSMC 65nm CMOS technology, and simulated using Cadence Spectre Simulator under 25$^{\circ}$\textbf{C}, TT corner. The approximate division approach achieved around $\textbf{28\%}$ reduction in the active design area. The heuristic-based approximation technique combined with accelerator optimization achieves a significant energy reduction of $\textbf{36\%}$ for a minimal image quality degradation of $\textbf{2\%}$ SAD. Simulation results also show that the proposed architecture consumes 15uW at the DCT and quantization stages to compress a colored 480p image at 6fps.

📄 PDF Abstract BibTeX arXiv:2406.16358

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Similar Papers 제목 키워드 기반

Improving Low-Precision Network Quantization via Bin Regularization

2021-01-01 · ICCV 2021 10 · Tiantian Han, Dong Li, Ji Liu, Lu Tian 외

Model quantization is an important mechanism for energy-efficient deployment of deep neural networks on resource-constrained devices by reducing the bit precision of weights and activations. However, it remains chall…

Quantization

Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency

2025-04-04 · Erik Johannes Husom, Arda Goknil, Merve Astekin, Lwin Khin Shar 외

Deploying Large Language Models (LLMs) on edge devices presents significant challenges due to computational constraints, memory limitations, inference speed, and energy consumption. Model quantization has emerged as a ke…

BenchmarkingGSM8KHumanEvalQuantization+2

EdgeProfiler: A Fast Profiling Framework for Lightweight LLMs on Edge Using Analytical Model

2025-06-06 · Alyssa Pinnock, Shakya Jayakody, Kawsher A Roxy, Md Rubel Ahmed

This paper introduces EdgeProfiler, a fast profiling framework designed for evaluating lightweight Large Language Models (LLMs) on edge systems. While LLMs offer remarkable capabilities in natural language understanding …

Natural Language UnderstandingQuantizationRaspberry Pi 4

LLMPi: Optimizing LLMs for High-Throughput on Raspberry Pi

2025-04-02 · Mahsa Ardakani, Jinendra Malekar, Ramtin Zand

Deploying Large Language Models (LLMs) on resource-constrained edge devices like the Raspberry Pi presents challenges in computational efficiency, power consumption, and response latency. This paper explores quantization…

Computational EfficiencyQuantization

A Performance Analysis of You Only Look Once Models for Deployment on Constrained Computational Edge Devices in Drone Applications

2025-02-06 · Lucas Rey, Ana M. Bernardos, Andrzej D. Dobrzycki, David Carramiñana 외

Advancements in embedded systems and Artificial Intelligence (AI) have enhanced the capabilities of Unmanned Aircraft Vehicles (UAVs) in computer vision. However, the integration of AI techniques o-nboard drones is const…

NVIDIA Jetson Orin Nanoobject-detectionObject DetectionQuantization+1