paper-with-me

홈 › Papers

SPADE-S: A Sparsity-Robust Foundational Forecaster

2025-07-24 · Malcolm Wolff, Matthew Li, Ravi Kiran Selvam, Hanjing Zhu, Kin G. Olivares, Ruijun Ma, Abhinav Katoch, Shankar Ramasubramanian, Mengfei Cao, Roberto Bandarra, Rahul Gopalsamy, Stefania La Vattiata, Sitan Yang, Michael W. Mahoney arxiv

Despite significant advancements in time series forecasting, accurate modeling of time series with strong heterogeneity in magnitude and/or sparsity patterns remains challenging for state-of-the-art deep learning architectures. We identify several factors that lead existing models to systematically underperform on low-magnitude and sparse time series, including loss functions with implicit biases toward high-magnitude series, training-time sampling methods, and limitations of time series encoding methods. SPADE-S is a robust forecasting architecture that significantly reduces magnitude- and sparsity-based systematic biases and improves overall prediction accuracy. Empirical results demonstrate that SPADE-S outperforms existing state-of-the-art approaches across a diverse set of use cases in demand forecasting. In particular, we show that, depending on the quantile forecast and magnitude of the series, SPADE-S can improve forecast accuracy by up to 15%. This results in P90 overall forecast accuracy gains of 2.21%, 6.58%, and 4.28%, and P50 forecast accuracy gains of 0.92%, 0.77%, and 1.95%, respectively, for each of three distinct datasets, ranging from 3 million to 700 million series, from a large online retailer.

📄 PDF Abstract BibTeX arXiv:2507.21155

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series Forecasting

Similar Papers 제목 키워드 기반

SPADE: Sparsity-Guided Debugging for Deep Neural Networks

2023-10-06 · Arshia Soltani Moakhar, Eugenia Iofinova, Elias Frantar, Dan Alistarh

It is known that sparsity can improve interpretability for deep neural networks. However, existing methods in the area either require networks that are pre-trained with sparsity constraints, or impose sparsity after the …

Learning Theory

SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference

2026-08-04 · Shanghao Liu, Renze Chen, Size Zheng, Yuanqiang Liu 외 arxiv

Video diffusion transformers (vDiTs) generate high quality but pay quadratic self-attention cost, making inference prohibitive at video-token scales. The challenge is input-adaptive sparsity: selecting critical Q/K/V tok…

Video Generation

SPADE: Sparse Pillar-based 3D Object Detection Accelerator for Autonomous Driving

2023-05-12 · Minjae Lee, Seongmin Park, Hyungmin Kim, Minyong Yoon 외

3D object detection using point cloud (PC) data is essential for perception pipelines of autonomous driving, where efficient encoding is key to meeting stringent resource and latency requirements. PointPillars, a widely …

3D Object DetectionAutonomous DrivingObjectobject-detection+1

SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics

2022-11-11 · Esha Saha, Lam Si Tung Ho, Giang Tran

Predicting the evolution of diseases is challenging, especially when the data availability is scarce and incomplete. The most popular tools for modelling and predicting infectious disease epidemics are compartmental mode…

AsyncSpade: Efficient Test-Time Scaling with Asynchronous Sparse Decoding

2025-10-08 · Shuqing Luo, Yilin Guan, Pingzhi Li, Hanrui Wang 외 arxiv

Test-time scaling (TTS) boosts LLM reasoning via long chain-of-thought (CoT), but the linear KV-cache growth amplifies the memory-bound bottleneck of LLM decoding. Query-aware page-level sparse decoding can achieve state…