paper-with-me

홈 › Papers

PhiNets: a scalable backbone for low-power AI at the edge

2021-10-01 · Francesco Paissan, Alberto Ancilotto, Elisabetta Farella

In the Internet of Things era, where we see many interconnected and heterogeneous mobile and fixed smart devices, distributing the intelligence from the cloud to the edge has become a necessity. Due to limited computational and communication capabilities, low memory and limited energy budget, bringing artificial intelligence algorithms to peripheral devices, such as the end-nodes of a sensor network, is a challenging task and requires the design of innovative methods. In this work, we present PhiNets, a new scalable backbone optimized for deep-learning-based image processing on resource-constrained platforms. PhiNets are based on inverted residual blocks specifically designed to decouple the computational cost, working memory, and parameter memory, thus exploiting all the available resources. With a YoloV2 detection head and Simple Online and Realtime Tracking, the proposed architecture has achieved the state-of-the-art results in (i) detection on the COCO and VOC2012 benchmarks, and (ii) tracking on the MOT15 benchmark. PhiNets reduce the parameter count of 87% to 93% with respect to previous state-of-the-art models (EfficientNetv1, MobileNetv2) and achieve better performance with lower computational cost. Moreover, we demonstrate our approach on a prototype node based on a STM32H743 microcontroller (MCU) with 2MB of internal Flash and 1MB of RAM and achieve power requirements in the order of 10 mW. The code for the PhiNets is publicly available on GitHub.

📄 PDF Abstract BibTeX arXiv:2110.00337

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Batch Normalization 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Darknet-19 설명 없음

Similar Papers 제목 키워드 기반

FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model

2026-06-18 · Yuhwan Jeong, Hyeonseong Kim, Daehyun We, Seonkyu Song 외 arxiv

Synthetic data for autonomous driving is surging, powered by diffusion models that promise scalable scene generation. Yet key obstacles remain, as enforcing multi-view and temporal consistency often relies on backbone fi…

Autonomous DrivingData AugmentationScene Generation

Three Pillars improving Vision Foundation Model Distillation for Lidar

2023-10-26 · CVPR 2024 1 · Gilles Puy, Spyros Gidaris, Alexandre Boulch, Oriane Siméoni 외

Self-supervised image backbones can be used to address complex 2D tasks (e.g., semantic segmentation, object discovery) very efficiently and with little or no downstream supervision. Ideally, 3D backbones for lidar shoul…

Autonomous DrivingObject DiscoverySegmentationSemantic Segmentation

Google-MedGemma Based Abnormality Detection in Musculoskeletal radiographs

2025-11-06 · Soumyajit Maity, Pranjal Kamboj, Sneha Maity, Rajat Singh 외 arxiv

This paper proposes a MedGemma-based framework for automatic abnormality detection in musculoskeletal radiographs. Departing from conventional autoencoder and neural network pipelines, the proposed method leverages the M…

Representation LearningBinary ClassificationFeature EngineeringTransfer Learning

Proteina: Scaling Flow-based Protein Structure Generative Models

2025-03-02 · Tomas Geffner, Kieran Didi, Zuobai Zhang, Danny Reidenbach 외

Recently, diffusion- and flow-based generative models of protein structures have emerged as a powerful tool for de novo protein design. Here, we develop Proteina, a new large-scale flow-based protein backbone generator t…

Protein Design

DeepFGS: Fine-Grained Scalable Coding for Learned Image Compression

2022-01-04 · Yi Ma, Yongqi Zhai, Ronggang Wang

Scalable coding, which can adapt to channel bandwidth variation, performs well in today's complex network environment. However, the existing scalable compression methods face two challenges: reduced compression performan…

DecoderImage CompressionMS-SSIMSSIM