DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation
In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known as concept drift. To handle concept drift, previous methods first detect when/where the concept drift happens and then adapt models to fit the distribution of the latest data. However, there are still many cases that some underlying factors of environment evolution are predictable, making it possible to model the future concept drift trend of the streaming data, while such cases are not fully explored in previous work. In this paper, we propose a novel method DDG-DA, that can effectively forecast the evolution of data distribution and improve the performance of models. Specifically, we first train a predictor to estimate the future data distribution, then leverage it to generate training samples, and finally train models on the generated data. We conduct experiments on three real-world tasks (forecasting on stock price trend, electricity load and solar irradiance) and obtain significant improvement on multiple widely-used models.
Code (1)
Tasks
Stock Market PredictionStock PredictionStock Trend PredictionSimilar Papers 제목 키워드 기반
Early Concept Drift Detection via Prediction Uncertainty
Concept drift, characterized by unpredictable changes in data distribution over time, poses significant challenges to machine learning models in streaming data scenarios. Although error rate-based concept drift detectors…
Drift DetectionPredictionAdapting Multi-modal Large Language Model to Concept Drift From Pre-training Onwards
Multi-modal Large Language Models (MLLMs) frequently face challenges from concept drift when dealing with real-world streaming data, wherein distributions change unpredictably. This mainly includes gradual drift due to l…
Language ModelingLanguage ModellingLarge Language ModelTowards Robust Endogenous Reasoning: Unifying Drift Adaptation in Non-Stationary Tuning
Reinforcement Fine-Tuning (RFT) has established itself as a critical paradigm for the alignment of Multi-modal Large Language Models (MLLMs) with complex human values and domain-specific requirements. Nevertheless, curre…
Domain GeneralizationAutonomous DrivingMedical DiagnosisRolling with the Punches: Resilient Contrastive Pre-training under Non-Stationary Drift
The remarkable success of large-scale contrastive pre-training, fueled by vast and curated datasets, is encountering new frontiers as the scaling paradigm evolves. A critical emerging challenge is the effective pre-train…
Causal InferenceContrastive LearningEAMDrift: An interpretable self retrain model for time series
The use of machine learning for time series prediction has become increasingly popular across various industries thanks to the availability of time series data and advancements in machine learning algorithms. However, tr…
Time SeriesTime Series ForecastingTime Series Prediction