Online Machine Learning in Big Data Streams
The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software architectures and efficient algorithms. The second one also imposes nontrivial theoretical restrictions on the modeling methods: In the data stream model, older data is no longer available to revise earlier suboptimal modeling decisions as the fresh data arrives. In this article, we provide an overview of distributed software architectures and libraries as well as machine learning models for online learning. We highlight the most important ideas for classification, regression, recommendation, and unsupervised modeling from streaming data, and we show how they are implemented in various distributed data stream processing systems. This article is a reference material and not a survey. We do not attempt to be comprehensive in describing all existing methods and solutions; rather, we give pointers to the most important resources in the field. All related sub-fields, online algorithms, online learning, and distributed data processing are hugely dominant in current research and development with conceptually new research results and software components emerging at the time of writing. In this article, we refer to several survey results, both for distributed data processing and for online machine learning. Compared to past surveys, our article is different because we discuss recommender systems in extended detail.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningRecommendation SystemsSimilar Papers 제목 키워드 기반
A Novel Online Real-time Classifier for Multi-label Data Streams
In this paper, a novel extreme learning machine based online multi-label classifier for real-time data streams is proposed. Multi-label classification is one of the actively researched machine learning paradigm that has …
ClassificationGeneral ClassificationMulti-class ClassificationMulti-Label Classification+1Standardized Evaluation of Machine Learning Methods for Evolving Data Streams
Due to the unspecified and dynamic nature of data streams, online machine learning requires powerful and flexible solutions. However, evaluating online machine learning methods under realistic conditions is difficult. Ex…
BIG-bench Machine LearningDrift Detectionfeature selectionRebalancing Learning on Evolving Data Streams
Nowadays, every device connected to the Internet generates an ever-growing stream of data (formally, unbounded). Machine Learning on unbounded data streams is a grand challenge due to its resource constraints. In fact, s…
BIG-bench Machine LearningDynamic Model Tree for Interpretable Data Stream Learning
Data streams are ubiquitous in modern business and society. In practice, data streams may evolve over time and cannot be stored indefinitely. Effective and transparent machine learning on data streams is thus often chall…
BIG-bench Machine LearningInterpretable Machine LearningSimplifying Hyperparameter Tuning in Online Machine Learning -- The spotRiverGUI
Batch Machine Learning (BML) reaches its limits when dealing with very large amounts of streaming data. This is especially true for available memory, handling drift in data streams, and processing new, unknown data. Onli…
Anomaly Detection