paper-with-me

Papers

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification

2023-12-17 · En Yu, Jie Lu, Bin Zhang, Guangquan Zhang

Multistream classification poses significant challenges due to the necessity for rapid adaptation in dynamic streaming processes with concept drift. Despite the growing research outcomes in this area, there has been a notable oversight regarding the temporal dynamic relationships between these streams, leading to the issue of negative transfer arising from irrelevant data. In this paper, we propose a novel Online Boosting Adaptive Learning (OBAL) method that effectively addresses this limitation by adaptively learning the dynamic correlation among different streams. Specifically, OBAL operates in a dual-phase mechanism, in the first of which we design an Adaptive COvariate Shift Adaptation (AdaCOSA) algorithm to construct an initialized ensemble model using archived data from various source streams, thus mitigating the covariate shift while learning the dynamic correlations via an adaptive re-weighting strategy. During the online process, we employ a Gaussian Mixture Model-based weighting mechanism, which is seamlessly integrated with the acquired correlations via AdaCOSA to effectively handle asynchronous drift. This approach significantly improves the predictive performance and stability of the target stream. We conduct comprehensive experiments on several synthetic and real-world data streams, encompassing various drifting scenarios and types. The results clearly demonstrate that OBAL achieves remarkable advancements in addressing multistream classification problems by effectively leveraging positive knowledge derived from multiple sources.

📄 PDF Abstract BibTeX arXiv:2312.10841

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Adaptive XGBoost for Evolving Data Streams

2020-05-15 · Jacob Montiel, Rory Mitchell, Eibe Frank, Bernhard Pfahringer 외

Boosting is an ensemble method that combines base models in a sequential manner to achieve high predictive accuracy. A popular learning algorithm based on this ensemble method is eXtreme Gradient Boosting (XGB). We prese…

Drift DetectionGeneral Classification

Adaptive Online Sequential ELM for Concept Drift Tackling

2016-10-06 · Arif Budiman, Mohamad Ivan Fanany, Chan Basaruddin

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Ex…

General Classificationregression

Adaptive Convolutional ELM For Concept Drift Handling in Online Stream Data

2016-10-07 · Arif Budiman, Mohamad Ivan Fanany, Chan Basaruddin

In big data era, the data continuously generated and its distribution may keep changes overtime. These challenges in online stream of data are known as concept drift. In this paper, we proposed the Adaptive Convolutional…

Automatically Optimized Gradient Boosting Trees for Classifying Large Volume High Cardinality Data Streams Under Concept Drift

2019-11-30 · Jobin Wilson, Amit Kumar Meher, Bivin Vinodkumar Bindu, Santanu Chaudhury 외

Data abundance along with scarcity of machine learning experts and domain specialists necessitates progressive automation of end-to-end machine learning workflows. To this end, Automated Machine Learning (AutoML) has eme…

AutoMLBIG-bench Machine LearningLifelong learning

A Drifting-Games Analysis for Online Learning and Applications to Boosting

2014-06-07 · NeurIPS 2014 12 · Haipeng Luo, Robert E. Schapire

We provide a general mechanism to design online learning algorithms based on a minimax analysis within a drifting-games framework. Different online learning settings (Hedge, multi-armed bandit problems and online convex …