Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting
We propose an energy amplification technique to address the issue that existing models easily overlook low-energy components in time series forecasting. This technique comprises an energy amplification block and an energy restoration block. The energy amplification block enhances the energy of low-energy components to improve the model's learning efficiency for these components, while the energy restoration block returns the energy to its original level. Moreover, considering that the energy-amplified data typically displays two distinct energy peaks in the frequency spectrum, we integrate the energy amplification technique with a seasonal-trend forecaster to model the temporal relationships of these two peaks independently, serving as the backbone for our proposed model, Amplifier. Additionally, we propose a semi-channel interaction temporal relationship enhancement block for Amplifier, which enhances the model's ability to capture temporal relationships from the perspective of the commonality and specificity of each channel in the data. Extensive experiments on eight time series forecasting benchmarks consistently demonstrate our model's superiority in both effectiveness and efficiency compared to state-of-the-art methods.
Code (2)
Tasks
SpecificityTime SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
Sparse Low-Ranked Self-Attention Transformer for Remaining Useful Lifetime Prediction of Optical Fiber Amplifiers
Optical fiber amplifiers are key elements in present optical networks. Failures of these components result in high financial loss of income of the network operator as the communication traffic over an affected link is in…
PredictionTwo-Port Feedback Analysis On Miller-Compensated Amplifiers
In this paper, various Miller-compensated amplifiers are analyzed by using the two-port feedback analysis together with the root-locus diagram. The proposed analysis solves problems of Miller theorem/approximation that f…
Vocal Bursts Valence PredictionSuperconducting Optoelectronic Neurons IV: Transmitter Circuits
A superconducting optoelectronic neuron will produce a small current pulse upon reaching threshold. We present an amplifier chain that converts this small current pulse to a voltage pulse sufficient to produce light from…
PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices
As neural networks (NN) are deployed across diverse sectors, their energy demand correspondingly grows. While several prior works have focused on reducing energy consumption during training, the continuous operation of M…
Bayesian OptimizationCPUEfficient Neural NetworkGPUWaveform Optimization for Wireless Power Transfer with Power Amplifier and Energy Harvester Non-Linearities
Waveform optimization has recently been shown to be a key technique to boost the efficiency and range of far-field wireless power transfer (WPT). Current research has optimized transmit waveform adaptive to channel state…