Fusing Multiple Algorithms for Heterogeneous Online Learning
This study addresses the challenge of online learning in contexts where agents accumulate disparate data, face resource constraints, and use different local algorithms. This paper introduces the Switched Online Learning Algorithm (SOLA), designed to solve the heterogeneous online learning problem by amalgamating updates from diverse agents through a dynamic switching mechanism contingent upon their respective performance and available resources. We theoretically analyze the design of the selecting mechanism to ensure that the regret of SOLA is bounded. Our findings show that the number of changes in selection needs to be bounded by a parameter dependent on the performance of the different local algorithms. Additionally, two test cases are presented to emphasize the effectiveness of SOLA, first on an online linear regression problem and then on an online classification problem with the MNIST dataset.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
IntentGC: a Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendation
The remarkable progress of network embedding has led to state-of-the-art algorithms in recommendation. However, the sparsity of user-item interactions (i.e., explicit preferences) on websites remains a big challenge for …
Network EmbeddingGappy local conformal auto-encoders for heterogeneous data fusion: in praise of rigidity
Fusing measurements from multiple, heterogeneous, partial sources, observing a common object or process, poses challenges due to the increasing availability of numbers and types of sensors. In this work we propose, imple…
Local DistortionExtracting Predictive Information from Heterogeneous Data Streams using Gaussian Processes
Financial markets are notoriously complex environments, presenting vast amounts of noisy, yet potentially informative data. We consider the problem of forecasting financial time series from a wide range of information so…
Gaussian ProcessesSentiment AnalysisTime SeriesTime Series AnalysisMultimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models
The commonly used latent space embedding techniques, such as Principal Component Analysis, Factor Analysis, and manifold learning techniques, are typically used for learning effective representations of homogeneous data.…
Anomaly DetectionImputationRecommendation SystemsVocal Bursts Intensity PredictionDecentralized Online Big Data Classification - a Bandit Framework
Distributed, online data mining systems have emerged as a result of applications requiring analysis of large amounts of correlated and high-dimensional data produced by multiple distributed data sources. We propose a dis…
ClassificationGeneral Classification