FTimeXer: Frequency-aware Time-series Transformer with Exogenous variables for Robust Carbon Footprint Forecasting
Accurate and up-to-date forecasting of the power grid's carbon footprint is crucial for effective product carbon footprint (PCF) accounting and informed decarbonization decisions. However, the carbon intensity of the grid exhibits high non-stationarity, and existing methods often struggle to effectively leverage periodic and oscillatory patterns. Furthermore, these methods tend to perform poorly when confronted with irregular exogenous inputs, such as missing data or misalignment. To tackle these challenges, we propose FTimeXer, a frequency-aware time-series Transformer designed with a robust training scheme that accommodates exogenous factors. FTimeXer features an Fast Fourier Transform (FFT)-driven frequency branch combined with gated time-frequency fusion, allowing it to capture multi-scale periodicity effectively. It also employs stochastic exogenous masking in conjunction with consistency regularization, which helps reduce spurious correlations and enhance stability. Experiments conducted on three real-world datasets show consistent improvements over strong baselines. As a result, these enhancements lead to more reliable forecasts of grid carbon factors, which are essential for effective PCF accounting and informed decision-making regarding decarbonization.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
FAiT: Frequency-Aware Inverted Transformer for Multivariate Time Series Forecasting
While Transformer-based architectures have established themselves as a dominant paradigm in Multivariate Time Series Forecasting (MTSF), their core self-attention mechanism inherently functions as a low-pass filter, syst…
Multivariate Time Series ForecastingComputational EfficiencyContent-aware Balanced Spectrum Encoding in Masked Modeling for Time Series Classification
Due to the superior ability of global dependency, transformer and its variants have become the primary choice in Masked Time-series Modeling (MTM) towards time-series classification task. In this paper, we experimentally…
DecoderTime SeriesTime Series ClassificationWaveFormer: Wavelet Embedding Transformer for Biomedical Signals
Biomedical signal classification presents unique challenges due to long sequences, complex temporal dynamics, and multi-scale frequency patterns that are poorly captured by standard transformer architectures. We propose …
Human Activity RecognitionTime Series ClassificationUnify and Anchor: A Context-Aware Transformer for Cross-Domain Time Series Forecasting
The rise of foundation models has revolutionized natural language processing and computer vision, yet their best practices to time series forecasting remains underexplored. Existing time series foundation models often ad…
Domain GeneralizationMixture-of-ExpertsTime SeriesTime Series ForecastingFEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting
Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global…
Time SeriesTime Series Analysis