paper-with-me

홈 › Papers

Comparative Analysis of Lightweight Deep Learning Models for Memory-Constrained Devices

2025-05-06 · Tasnim Shahriar

This paper presents a comprehensive evaluation of lightweight deep learning models for image classification, emphasizing their suitability for deployment in resource-constrained environments such as low-memory devices. Five state-of-the-art architectures - MobileNetV3 Small, ResNet18, SqueezeNet, EfficientNetV2-S, and ShuffleNetV2 - are benchmarked across three diverse datasets: CIFAR-10, CIFAR-100, and Tiny ImageNet. The models are assessed using four key performance metrics: classification accuracy, inference time, floating-point operations (FLOPs), and model size. Additionally, we investigate the impact of hyperparameter tuning, data augmentation, and training paradigms by comparing pretrained models with scratch-trained counterparts, focusing on MobileNetV3 Small. Our findings reveal that transfer learning significantly enhances model accuracy and computational efficiency, particularly for complex datasets like Tiny ImageNet. EfficientNetV2 consistently achieves the highest accuracy, while MobileNetV3 offers the best balance between accuracy and efficiency, and SqueezeNet excels in inference speed and compactness. This study highlights critical trade-offs between accuracy and efficiency, offering actionable insights for deploying lightweight models in real-world applications where computational resources are limited. By addressing these challenges, this research contributes to optimizing deep learning systems for edge computing and mobile platforms.

📄 PDF Abstract BibTeX arXiv:2505.03303

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyData AugmentationEdge-computingimage-classificationImage ClassificationTransfer Learning

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Average Pooling 설명 없음
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Sigmoid Activation 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Comparative Efficiency Analysis of Lightweight Transformer Models: A Multi-Domain Empirical Benchmark for Enterprise NLP Deployment

2026-01-01 · Muhammad Shahmeer Khan arxiv

In the rapidly evolving landscape of enterprise natural language processing (NLP), the demand for efficient, lightweight models capable of handling multi-domain text automation tasks has intensified. This study conducts …

Hyperparameter OptimizationHate Speech Detection

Improving the Efficiency of Transformers for Resource-Constrained Devices

2021-06-30 · Hamid Tabani, Ajay Balasubramaniam, Shabbir Marzban, Elahe Arani 외

Transformers provide promising accuracy and have become popular and used in various domains such as natural language processing and computer vision. However, due to their massive number of model parameters, memory and co…

Federated Hyperdimensional Computing for Resource-Constrained Industrial IoT

2026-03-20 · Nikita Zeulin, Olga Galinina, Nageen Himayat, Sergey Andreev arxiv

In the Industrial Internet of Things (IIoT) systems, edge devices often operate under strict constraints in memory, compute capability, and wireless bandwidth. These limitations challenge the deployment of advanced data …

Federated Learning

Boosted Trees on a Diet: Compact Models for Resource-Constrained Devices

2025-10-30 · Nina Herrmann, Jan Stenkamp, Benjamin Karic, Stefan Oehmcke 외 arxiv

Deploying machine learning models on compute-constrained devices has become a key building block of modern IoT applications. In this work, we present a compression scheme for boosted decision trees, addressing the growin…

Decision Making

Lightweight Transformer Architectures for Edge Devices in Real-Time Applications

2026-01-05 · Hema Hariharan Samson arxiv

The deployment of transformer-based models on resource-constrained edge devices represents a critical challenge in enabling real-time artificial intelligence applications. This comprehensive survey examines lightweight t…

Neural Architecture SearchKnowledge DistillationModel Compression