paper-with-me

Papers

MLPerf Tiny Benchmark

2021-06-14 · Colby Banbury, Vijay Janapa Reddi, Peter Torelli, Jeremy Holleman, Nat Jeffries, Csaba Kiraly, Pietro Montino, David Kanter, Sebastian Ahmed, Danilo Pau, Urmish Thakker, Antonio Torrini, Peter Warden, Jay Cordaro, Giuseppe Di Guglielmo, Javier Duarte, Stephen Gibellini, Videet Parekh, Honson Tran, Nhan Tran, Niu Wenxu, Xu Xuesong

Advancements in ultra-low-power tiny machine learning (TinyML) systems promise to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted and easily reproducible benchmark for these systems. To meet this need, we present MLPerf Tiny, the first industry-standard benchmark suite for ultra-low-power tiny machine learning systems. The benchmark suite is the collaborative effort of more than 50 organizations from industry and academia and reflects the needs of the community. MLPerf Tiny measures the accuracy, latency, and energy of machine learning inference to properly evaluate the tradeoffs between systems. Additionally, MLPerf Tiny implements a modular design that enables benchmark submitters to show the benefits of their product, regardless of where it falls on the ML deployment stack, in a fair and reproducible manner. The suite features four benchmarks: keyword spotting, visual wake words, image classification, and anomaly detection.

📄 PDF Abstract BibTeX arXiv:2106.07597

Code (2)

mlcommons/tiny 공식 구현 tf
mlcommons/tiny_results_v0.5 공식 구현

Tasks

Anomaly DetectionBIG-bench Machine Learningimage-classificationImage ClassificationKeyword Spotting

Similar Papers 제목 키워드 기반

Benchmarking TinyML Systems: Challenges and Direction

2020-03-10 · Colby R. Banbury, Vijay Janapa Reddi, Max Lam, William Fu 외

Recent advancements in ultra-low-power machine learning (TinyML) hardware promises to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted benchmark …

BenchmarkingPosition

Open-source FPGA-ML codesign for the MLPerf Tiny Benchmark

2022-06-23 · Hendrik Borras, Giuseppe Di Guglielmo, Javier Duarte, Nicolò Ghielmetti 외

We present our development experience and recent results for the MLPerf Tiny Inference Benchmark on field-programmable gate array (FPGA) platforms. We use the open-source hls4ml and FINN workflows, which aim to democrati…

Anomaly Detectionimage-classificationImage ClassificationKeyword Spotting+1

MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI

2024-10-15 · Arya Tschand, Arun Tejusve Raghunath Rajan, Sachin Idgunji, Anirban Ghosh 외

Rapid adoption of machine learning (ML) technologies has led to a surge in power consumption across diverse systems, from tiny IoT devices to massive datacenter clusters. Benchmarking the energy efficiency of these syste…

Benchmarking

Demystifying the MLPerf Benchmark Suite

2019-08-24 · Snehil Verma, Qinzhe Wu, Bagus Hanindhito, Gunjan Jha 외

MLPerf, an emerging machine learning benchmark suite strives to cover a broad range of applications of machine learning. We present a study on its characteristics and how the MLPerf benchmarks differ from some of the pre…

BIG-bench Machine LearningCPUGPUScheduling

T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXit

2022-07-14 · Nikhil P Ghanathe, Steve Wilton

Deploying Machine learning (ML) on milliwatt-scale edge devices (tinyML) is gaining popularity due to recent breakthroughs in ML and Internet of Things (IoT). Most tinyML research focuses on model compression techniques …

image-classificationImage ClassificationKeyword SpottingModel Compression+1