paper-with-me

홈 › Papers

Analysis of Hyperparameter Optimization Effects on Lightweight Deep Models for Real-Time Image Classification

2025-07-31 · Vineet Kumar Rakesh, Soumya Mazumdar, Tapas Samanta, Hemendra Kumar Pandey, Amitabha Das arxiv

Lightweight convolutional and transformer-based networks are increasingly preferred for real-time image classification, especially on resource-constrained devices. This study evaluates the impact of hyperparameter optimization on the accuracy and deployment feasibility of seven modern lightweight architectures: ConvNeXt-T, EfficientNetV2-S, MobileNetV3-L, MobileViT v2 (S/XS), RepVGG-A2, and TinyViT-21M, trained on a class-balanced subset of 90,000 images from ImageNet-1K. Under standardized training settings, this paper investigates the influence of learning rate schedules, augmentation, optimizers, and initialization on model performance. Inference benchmarks are performed using an NVIDIA L40s GPU with batch sizes ranging from 1 to 512, capturing latency and throughput in real-time conditions. This work demonstrates that controlled hyperparameter variation significantly alters convergence dynamics in lightweight CNN and transformer backbones, providing insight into stability regions and deployment feasibility in edge artificial intelligence. Our results reveal that tuning alone leads to a top-1 accuracy improvement of 1.5 to 3.5 percent over baselines, and select models (e.g., RepVGG-A2, MobileNetV3-L) deliver latency under 5 milliseconds and over 9,800 frames per second, making them ideal for edge deployment. This work provides reproducible, subset-based insights into lightweight hyperparameter tuning and its role in balancing speed and accuracy. The code and logs may be seen at: https://vineetkumarrakesh.github.io/lcnn-opt

📄 PDF Abstract BibTeX arXiv:2507.23315

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter OptimizationImage Classification

Similar Papers 제목 키워드 기반

The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters

2025-09-24 · Scott Koermer, Natalie Klein arxiv

In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neu…

Dimensionality Reduction

Which Hyperparameters Matter? A Game-Theoretic Framework for Interpretable Hyperparameter Sensitivity Analysis

2026-07-17 · Nyi Nyi Aung, Heepeom Shin, Abigail Lawlor, Adrian Stein arxiv

This work presents a game-theoretic framework for interpretable hyperparameter-objective interaction analysis rather than proposing a new optimization algorithm. In the proposed framework, Shapley Effects are employed fo…

MOFA: Modular Factorial Design for Hyperparameter Optimization

2020-11-18 · Bo Xiong, Yimin Huang, Hanrong Ye, Steffen Staab 외

This paper presents a novel and lightweight hyperparameter optimization (HPO) method, MOdular FActorial Design (MOFA). MOFA pursues several rounds of HPO, where each round alternates between exploration of hyperparameter…

Hyperparameter OptimizationModel Selection

R+R:Understanding Hyperparameter Effects in DP-SGD

2024-11-04 · Felix Morsbach, Jan Reubold, Thorsten Strufe

Research on the effects of essential hyperparameters of DP-SGD lacks consensus, verification, and replication. Contradictory and anecdotal statements on their influence make matters worse. While DP-SGD is the standard op…

Privacy Preserving

Distributional Extrapolation for Interactions

2026-08-20 · Marin Šola, Xinwei Shen, Peter Bühlmann arxiv

Predicting combinatorial effects from limited-range observations is a fundamental challenge in many scientific domains, including drug discovery and hyperparameter optimization. We study combinatorial extrapolation, wher…

Hyperparameter OptimizationDrug Discovery