paper-with-me

Papers

An Analysis of Layer-Freezing Strategies for Enhanced Transfer Learning in YOLO Architectures

2025-09-05 · Andrzej D. Dobrzycki, Ana M. Bernardos, José R. Casar arxiv

The You Only Look Once (YOLO) architecture is crucial for real-time object detection. However, deploying it in resource-constrained environments such as unmanned aerial vehicles (UAVs) requires efficient transfer learning. Although layer freezing is a common technique, the specific impact of various freezing configurations on contemporary YOLOv8 and YOLOv10 architectures remains unexplored, particularly with regard to the interplay between freezing depth, dataset characteristics, and training dynamics. This research addresses this gap by presenting a detailed analysis of layer-freezing strategies. We systematically investigate multiple freezing configurations across YOLOv8 and YOLOv10 variants using four challenging datasets that represent critical infrastructure monitoring. Our methodology integrates a gradient behavior analysis (L2 norm) and visual explanations (Grad-CAM) to provide deeper insights into training dynamics under different freezing strategies. Our results reveal that there is no universal optimal freezing strategy but, rather, one that depends on the properties of the data. For example, freezing the backbone is effective for preserving general-purpose features, while a shallower freeze is better suited to handling extreme class imbalance. These configurations reduce graphics processing unit (GPU) memory consumption by up to 28% compared to full fine-tuning and, in some cases, achieve mean average precision (mAP@50) scores that surpass those of full fine-tuning. Gradient analysis corroborates these findings, showing distinct convergence patterns for moderately frozen models. Ultimately, this work provides empirical findings and practical guidelines for selecting freezing strategies. It offers a practical, evidence-based approach to balanced transfer learning for object detection in scenarios with limited resources.

📄 PDF Abstract BibTeX arXiv:2509.05490

Code (0)

등록된 구현이 없습니다.

Tasks

Real-Time Object DetectionTransfer Learning

Similar Papers 제목 키워드 기반

Effects of Layer Freezing on Transferring a Speech Recognition System to Under-resourced Languages

2021-02-08 · KONVENS (WS) 2021 9 · Onno Eberhard, Torsten Zesch

In this paper, we investigate the effect of layer freezing on the effectiveness of model transfer in the area of automatic speech recognition. We experiment with Mozilla's DeepSpeech architecture on German and Swiss Germ…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Swin Transformer with Enhanced Dropout and Layer-wise Unfreezing for Facial Expression Recognition in Mental Health Detection

2024-12-02 · Engineering, Technology & Applied Science Research 2024 12 · Mr. Mujiyanto, Mr. Arief Setyanto, Prof. Ema Utami and Prof. Kusrini Kusrini

This study presents an improved Facial Expression Recognition (FER) model using Swin transformers for enhanced performance in detecting mental health through facial emotion analysis. In addition, some techniques involvin…

Emotion RecognitionFacial Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)+3

TrOCR for Medieval HTR: A Systematic Ablation Study with Cross-Dataset Validation

2026-06-23 · Sachin Sharma, Michele Flammini, Federico Simonetta arxiv

Fine-tuning transformer-based handwritten text recognition (HTR) models on medieval manuscripts is challenging because these models are pre-trained on modern text and must adapt to a very different visual domain. This pa…

Handwritten Text RecognitionData Augmentation

Gradient Sparsification For Masked Fine-Tuning of Transformers

2023-07-19 · James O' Neill, Sourav Dutta

Fine-tuning pretrained self-supervised language models is widely adopted for transfer learning to downstream tasks. Fine-tuning can be achieved by freezing gradients of the pretrained network and only updating gradients …

Transfer Learning

How transferable are features in convolutional neural network acoustic models across languages?

2018-10-22 · NIPS Workshop IRASL 2018 · Anonymous

Characterization of the representations learned in intermediate layers of deep networks can provide valuable insight into the nature of a task and can guide the development of well-tailored learning strategies. Here we s…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Specificityspeech-recognition+2