Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Models
Predictive machine learning models nowadays are often updated in a stateless and expensive way. The two main future trends for companies that want to build machine learning-based applications and systems are real-time inference and continual updating. Unfortunately, both trends require a mature infrastructure that is hard and costly to realize on-premise. This paper defines a novel software service and model delivery infrastructure termed Continual Learning-as-a-Service (CLaaS) to address these issues. Specifically, it embraces continual machine learning and continuous integration techniques. It provides support for model updating and validation tools for data scientists without an on-premise solution and in an efficient, stateful and easy-to-use manner. Finally, this CL model service is easy to encapsulate in any machine learning infrastructure or cloud system. This paper presents the design and implementation of a CLaaS instantiation, called LiquidBrain, evaluated in two real-world scenarios. The former is a robotic object recognition setting using the CORe50 dataset while the latter is a named category and attribute prediction using the DeepFashion-C dataset in the fashion domain. Our preliminary results suggest the usability and efficiency of the Continual Learning model services and the effectiveness of the solution in addressing real-world use-cases regardless of where the computation happens in the continuum Edge-Cloud.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeBIG-bench Machine LearningContinual LearningObject RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CLaaS: Continual learning as a service for sample efficient online learning
Deployed large language model agents must adapt to distribution shift in dynamic environments. Ideally, adaptation can be performed from accumulated agent experiences and retain prior capabilities while transferring to f…
Continual LearningExplainability and Continual Learning meet Federated Learning at the Network Edge
As edge devices become more capable and pervasive in wireless networks, there is growing interest in leveraging their collective compute power for distributed learning. However, optimizing learning at the network edge en…
Continual LearningEdge-computingExplainable ModelsFederated Learning+2Online Predictive Optimization Framework for Stochastic Demand-Responsive Transit Services
This study develops an online predictive optimization framework for dynamically operating a transit service in an area of crowd movements. The proposed framework integrates demand prediction and supply optimization to pe…
Autonomous Vehiclesquantile regressionComplementary Learning System Empowers Online Continual Learning of Vehicle Motion Forecasting in Smart Cities
Artificial intelligence underpins most smart city services, yet deep neural network (DNN) that forecasts vehicle motion still struggle with catastrophic forgetting, the loss of earlier knowledge when models are updated. …
Continual LearningMotion ForecastingPredictive Coding-based Deep Neural Network Fine-tuning for Computationally Efficient Domain Adaptation
As deep neural networks are increasingly deployed in dynamic, real-world environments, relying on a single static model is often insufficient. Changes in input data distributions caused by sensor drift or lighting variat…
Computational EfficiencyRepresentation LearningContinual LearningDomain Adaptation