paper-with-me

홈 › Papers

Beyond MSE: Ordinal Cross-Entropy for Probabilistic Time Series Forecasting

2025-11-13 · Jieting Wang, Huimei Shi, Feijiang Li, Xiaolei Shang arxiv

Time series forecasting is an important task that involves analyzing temporal dependencies and underlying patterns (such as trends, cyclicality, and seasonality) in historical data to predict future values or trends. Current deep learning-based forecasting models primarily employ Mean Squared Error (MSE) loss functions for regression modeling. Despite enabling direct value prediction, this method offers no uncertainty estimation and exhibits poor outlier robustness. To address these limitations, we propose OCE-TS, a novel ordinal classification approach for time series forecasting that replaces MSE with Ordinal Cross-Entropy (OCE) loss, preserving prediction order while quantifying uncertainty through probability output. Specifically, OCE-TS begins by discretizing observed values into ordered intervals and deriving their probabilities via a parametric distribution as supervision signals. Using a simple linear model, we then predict probability distributions for each timestep. The OCE loss is computed between the cumulative distributions of predicted and ground-truth probabilities, explicitly preserving ordinal relationships among forecasted values. Through theoretical analysis using influence functions, we establish that cross-entropy (CE) loss exhibits superior stability and outlier robustness compared to MSE loss. Empirically, we compared OCE-TS with five baseline models-Autoformer, DLinear, iTransformer, TimeXer, and TimeBridge-on seven public time series datasets. Using MSE and Mean Absolute Error (MAE) as evaluation metrics, the results demonstrate that OCE-TS consistently outperforms benchmark models. The codeis publicly available at: https://github.com/Shi-hm/OCE-TS.

📄 PDF Abstract BibTeX arXiv:2511.10200

Code (0)

등록된 구현이 없습니다.

Tasks

Probabilistic Time Series ForecastingOrdinal ClassificationValue prediction

Similar Papers 제목 키워드 기반

Deep Neural Networks with Ordinal Loss for Medical Applications

2026-06-24 · Tal Dvora, Rotem Haba, Gonen Singer arxiv

In many prediction problems in medical applications, target labels exhibit an inherent ordinal structure, where class ordering reflects clinically meaningful severity levels. The cost associated with misclassification is…

A simple log-based loss function for ordinal text classification

2021-11-16 · ACL ARR November 2021 11 · Anonymous

The cross-entropy loss function is widely used and generally considered the default loss function for text classification. When it comes to ordinal text classification where there is an ordinal relationship between label…

Classificationtext-classificationText Classification

A Simple Log-based Loss Function for Ordinal Text Classification

2022-10-01 · COLING 2022 10 · François Castagnos, Martin Mihelich, Charles Dognin

The cross-entropy loss function is widely used and generally considered the default loss function for text classification. When it comes to ordinal text classification where there is an ordinal relationship between label…

Classificationtext-classificationText Classification

Improving Deep Regression with Ordinal Entropy

2023-01-21 · Shihao Zhang, Linlin Yang, Michael Bi Mi, Xiaoxu Zheng 외

In computer vision, it is often observed that formulating regression problems as a classification task often yields better performance. We investigate this curious phenomenon and provide a derivation to show that classif…

ClassificationCrowd CountingDepth EstimationMonocular Depth Estimation+1

Calibration of ordinal regression networks

2024-10-21 · Daehwan Kim, Haejun Chung, Ikbeom Jang

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims t…

regression