paper-with-me

홈 › Papers

Fine-Tuning Without Forgetting: Adaptation of YOLOv8 Preserves COCO Performance

2025-05-02 · Vishal Gandhi, Sagar Gandhi

The success of large pre-trained object detectors hinges on their adaptability to diverse downstream tasks. While fine-tuning is the standard adaptation method, specializing these models for challenging fine-grained domains necessitates careful consideration of feature granularity. The critical question remains: how deeply should the pre-trained backbone be fine-tuned to optimize for the specialized task without incurring catastrophic forgetting of the original general capabilities? Addressing this, we present a systematic empirical study evaluating the impact of fine-tuning depth. We adapt a standard YOLOv8n model to a custom, fine-grained fruit detection dataset by progressively unfreezing backbone layers (freeze points at layers 22, 15, and 10) and training. Performance was rigorously evaluated on both the target fruit dataset and, using a dual-head evaluation architecture, on the original COCO validation set. Our results demonstrate unequivocally that deeper fine-tuning (unfreezing down to layer 10) yields substantial performance gains (e.g., +10\% absolute mAP50) on the fine-grained fruit task compared to only training the head. Strikingly, this significant adaptation and specialization resulted in negligible performance degradation (<0.1\% absolute mAP difference) on the COCO benchmark across all tested freeze levels. We conclude that adapting mid-to-late backbone features is highly effective for fine-grained specialization. Critically, our results demonstrate this adaptation can be achieved without the commonly expected penalty of catastrophic forgetting, presenting a compelling case for exploring deeper fine-tuning strategies, particularly when targeting complex domains or when maximizing specialized performance is paramount.

📄 PDF Abstract BibTeX arXiv:2505.01016

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting

2024-02-19 · Haolin Chen, Philip N. Garner

We are motivated primarily by the adaptation of text-to-speech synthesis models; however we argue that more generic parameter-efficient fine-tuning (PEFT) is an appropriate framework to do such adaptation. Nevertheless, …

Language ModelingLanguage Modellingparameter-efficient fine-tuningSpeech Synthesis+3

Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation

2025-01-26 · Reza Akbarian Bafghi, Carden Bagwell, Avinash Ravichandran, Ashish Shrivastava 외

Adapting deep learning models to new domains often requires computationally intensive retraining and risks catastrophic forgetting. While fine-tuning enables domain-specific adaptation, it can reduce robustness to distri…

parameter-efficient fine-tuning

Fine-Tuning Without Forgetting via Loss-Adaptive Learning Rates

2026-05-19 · Parjanya Prajakta Prashant, Jiongli Zhu, Aldan Creo, Babak Salimi arxiv

Fine-tuning large language models on new data improves task performance but degrades capabilities learned during pretraining, a phenomenon known as catastrophic forgetting. Existing methods mitigate this by modifying the…

Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation

2025-09-21 · Junzhuo Li, Bo Wang, Xiuze Zhou, Xuming Hu arxiv

Mixture-of-Experts (MoE) models offer immense capacity via sparsely gated expert subnetworks, yet adapting them to multiple domains without catastrophic forgetting remains an open challenge. Existing approaches either in…

Domain Adaptation

Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuning

2025-06-06 · Yangui Fang, Jing Peng, Xu Li, Yu Xi 외

Recent advances in automatic speech recognition (ASR) have combined speech encoders with large language models (LLMs) through projection, forming Speech LLMs with strong performance. However, adapting them to new domains…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain Adaptationspeech-recognition+1