Online ML Self-adaptation in Face of Traps
Online machine learning (ML) is often used in self-adaptive systems to strengthen the adaptation mechanism and improve the system utility. Despite such benefits, applying online ML for self-adaptation can be challenging, and not many papers report its limitations. Recently, we experimented with applying online ML for self-adaptation of a smart farming scenario and we had faced several unexpected difficulties -- traps -- that, to our knowledge, are not discussed enough in the community. In this paper, we report our experience with these traps. Specifically, we discuss several traps that relate to the specification and online training of the ML-based estimators, their impact on self-adaptation, and the approach used to evaluate the estimators. Our overview of these traps provides a list of lessons learned, which can serve as guidance for other researchers and practitioners when applying online ML for self-adaptation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Visual Prompt Tuning for Test-time Domain Adaptation
Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging…
Domain AdaptationTest-time AdaptationUnsupervised Domain AdaptationVisual Prompt TuningTAMPC: A Controller for Escaping Traps in Novel Environments
We propose an approach to online model adaptation and control in the challenging case of hybrid and discontinuous dynamics where actions may lead to difficult-to-escape "trap" states, under a given controller. We first l…
Model Predictive ControlBoosting Video Object Segmentation based on Scale Inconsistency
We present a refinement framework to boost the performance of pre-trained semi-supervised video object segmentation (VOS) models. Our work is based on scale inconsistency, which is motivated by the observation that exist…
ObjectSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object Segmentation+1Climate Immobility Traps: A Household-Level Test
The complex relationship between climate shocks, migration, and adaptation hampers a rigorous understanding of the heterogeneous mobility outcomes of farm households exposed to climate risk. To unpack this heterogeneity,…
Bootstrapping Linear Models for Fast Online Adaptation in Human-Agent Collaboration
Agents that assist people need to have well-initialized policies that can adapt quickly to align with their partners' reward functions. Initializing policies to maximize performance with unknown partners can be achieved …
Human Agent CollaborationImitation Learningregression