Constraint-Driven Warm-Freeze for Efficient Transfer Learning in Photovoltaic Systems
Detecting cyberattacks in photovoltaic (PV) monitoring and MPPT control signals requires models that are robust to bias, drift, and transient spikes, yet lightweight enough for resource-constrained edge controllers. While deep learning outperforms traditional physics-based diagnostics and handcrafted features, standard fine-tuning is computationally prohibitive for edge devices. Furthermore, existing Parameter-Efficient Fine-Tuning (PEFT) methods typically apply uniform adaptation or rely on expensive architectural searches, lacking the flexibility to adhere to strict hardware budgets. To bridge this gap, we propose Constraint-Driven Warm-Freeze (CDWF), a budget-aware adaptation framework. CDWF leverages a brief warm-start phase to quantify gradient-based block importance, then solves a constrained optimization problem to dynamically allocate full trainability to high-impact blocks while efficiently adapting the remaining blocks via Low-Rank Adaptation (LoRA). We evaluate CDWF on standard vision benchmarks (CIFAR-10/100) and a novel PV cyberattack dataset, transferring from bias pretraining to drift and spike detection. The experiments demonstrate that CDWF retains 90 to 99% of full fine-tuning performance while reducing trainable parameters by up to 120x. These results establish CDWF as an effective, importance-guided solution for reliable transfer learning under tight edge constraints.
Code (0)
등록된 구현이 없습니다.
Tasks
parameter-efficient fine-tuningTransfer LearningSimilar Papers 제목 키워드 기반
Virtual reference feedback tuning with robustness constraints: A swarm intelligence solution
The simplified modeling of a complex system allied with a low-order controller structure can lead to poor closed-loop performance and robustness. A feasible solution is to avoid the necessity of a model by using data for…
Metaheuristic OptimizationDesign, modeling and control of a hybrid grid-connected photovoltaic-wind system for the region of Adrar, Algeria
The use of fossil energy for electricity production is an evident source of pollution, global warming and climate change. Consequently, researchers have been working to shift toward sustainable and clean energy by exploi…
Feature-driven reinforcement learning for photovoltaic in continuous intraday trading
Sequential intraday electricity trading allows photovoltaic (PV) operators to reduce imbalance settlement costs as forecasts improve throughout the day. Yet deployable trading policies must jointly handle forecast uncert…
Reinforcement LearningTimelyFreeze: Adaptive Parameter Freezing Mechanism for Pipeline Parallelism
Pipeline parallelism enables training models that exceed single-device memory, but practical throughput remains limited by pipeline bubbles. Although parameter freezing can improve training throughput by adaptively skipp…
LLM-Powered Swarms: A New Frontier or a Conceptual Stretch?
Swarm intelligence traditionally refers to systems of simple, decentralized agents whose local interactions lead to emergent, collective behavior. Recently, the term 'swarm' has been extended to describe AI systems like …