paper-with-me

홈 › Papers

Frequency Enhanced Pre-training for Cross-city Few-shot Traffic Forecasting

2024-06-03 · Zhanyu Liu, Jianrong Ding, Guanjie Zheng

The field of Intelligent Transportation Systems (ITS) relies on accurate traffic forecasting to enable various downstream applications. However, developing cities often face challenges in collecting sufficient training traffic data due to limited resources and outdated infrastructure. Recognizing this obstacle, the concept of cross-city few-shot forecasting has emerged as a viable approach. While previous cross-city few-shot forecasting methods ignore the frequency similarity between cities, we have made an observation that the traffic data is more similar in the frequency domain between cities. Based on this fact, we propose a \textbf{F}requency \textbf{E}nhanced \textbf{P}re-training Framework for \textbf{Cross}-city Few-shot Forecasting (\textbf{FEPCross}). FEPCross has a pre-training stage and a fine-tuning stage. In the pre-training stage, we propose a novel Cross-Domain Spatial-Temporal Encoder that incorporates the information of the time and frequency domain and trains it with self-supervised tasks encompassing reconstruction and contrastive objectives. In the fine-tuning stage, we design modules to enrich training samples and maintain a momentum-updated graph structure, thereby mitigating the risk of overfitting to the few-shot training data. Empirical evaluations performed on real-world traffic datasets validate the exceptional efficacy of FEPCross, outperforming existing approaches of diverse categories and demonstrating characteristics that foster the progress of cross-city few-shot forecasting.

📄 PDF Abstract BibTeX arXiv:2406.02614

Code (1)

zhyliu00/FEPCross 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Photonic Quantum-Enhanced Knowledge Distillation

2026-03-16 · Kuan-Cheng Chen, Shang Yu, Chen-Yu Liu, Samuel Yen-Chi Chen 외 arxiv

Photonic quantum processors naturally produce intrinsically stochastic measurement outcomes, offering a hardware-native source of structured randomness that can be exploited during machine-learning training. Here we intr…

Knowledge Distillation

Iterative Training of Physics-Informed Neural Networks with Fourier-enhanced Features

2025-10-22 · Yulun Wu, Miguel Aguiar, Karl H. Johansson, Matthieu Barreau arxiv

Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs). To overcome this issue, we propose I…

FreqAnchorAD: Language-Free Zero-Shot Anomaly Detection via Frequency-Deviation Anchoring

2026-08-01 · Jianfeng Qiu, Peiyuan Li, Juan Xie, Xueliang Ma 외 arxiv

Zero-shot anomaly detection (ZSAD) aims to detect anomalies and localize defective regions in unseen target domains without target training data. Recent ZSAD methods build on pretrained vision models, particularly CLIP, …

Anomaly Detection

CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection

2026-06-18 · Junhao Cai, Junyu Chen, Deyu Zeng, Junhao Pang 외 arxiv

Few-shot anomaly detection remains challenging due to limited training data. Multi-modal anomaly detection (MAD) offers a viable solution, leveraging 3D geometric cues to enrich 2D RGB representations and compensate for …

Anomaly Detection

Get the Point! Graph Enhanced Candidate Retrieval for Zero-shot Entity Linking

2021-11-16 · ACL ARR November 2021 11 · Anonymous

For the retrieval phase of the zero-shot entity linking task, BERT has been widely used to represent the mentions and entities with the sentence embeddings. However, the sentence embeddings obtained by BERT are dominated…

Entity LinkingEntity RetrievalGraph Neural NetworkRetrieval+4