paper-with-me

홈 › Papers

UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting

2023-10-15 · Xu Liu, Junfeng Hu, Yuan Li, Shizhe Diao, Yuxuan Liang, Bryan Hooi, Roger Zimmermann

Multivariate time series forecasting plays a pivotal role in contemporary web technologies. In contrast to conventional methods that involve creating dedicated models for specific time series application domains, this research advocates for a unified model paradigm that transcends domain boundaries. However, learning an effective cross-domain model presents the following challenges. First, various domains exhibit disparities in data characteristics, e.g., the number of variables, posing hurdles for existing models that impose inflexible constraints on these factors. Second, the model may encounter difficulties in distinguishing data from various domains, leading to suboptimal performance in our assessments. Third, the diverse convergence rates of time series domains can also result in compromised empirical performance. To address these issues, we propose UniTime for effective cross-domain time series learning. Concretely, UniTime can flexibly adapt to data with varying characteristics. It also uses domain instructions and a Language-TS Transformer to offer identification information and align two modalities. In addition, UniTime employs masking to alleviate domain convergence speed imbalance issues. Our extensive experiments demonstrate the effectiveness of UniTime in advancing state-of-the-art forecasting performance and zero-shot transferability.

📄 PDF Abstract BibTeX arXiv:2310.09751

Code (1)

liuxu77/unitime 공식 구현 pytorch

Tasks

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook

2025-02-27 · Yidi Jiang, Qian Chen, Shengpeng Ji, Yu Xi 외

The emergence of audio language models is empowered by neural audio codecs, which establish critical mappings between continuous waveforms and discrete tokens compatible with language model paradigms. The evolutionary tr…

Language ModelingLanguage ModellingMixture-of-Experts

A Unified Bellman Optimality Principle Combining Reward Maximization and Empowerment

2019-07-26 · NeurIPS 2019 12 · Felix Leibfried, Sergio Pascual-Diaz, Jordi Grau-Moya

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large numbe…

MuJoCoReinforcement LearningReinforcement Learning (RL)

Large Model Empowered Streaming Speech Semantic Communications

2025-01-10 · Zhenzi Weng, Zhijin Qin, Geoffrey Ye Li

In this paper, we introduce a large model-empowered streaming semantic communication system for speech transmission across various languages, named LSSC-ST. Specifically, we devise an edge-device collaborative semantic c…

modelSemantic CommunicationTranslation

A Unified Non-Parametric and Interpretable Point Cloud Analysis via t-FCW Graph Representation

2026-05-14 · Haijian Lai, Bowen Liu, Man Xu, Chan-Tong Lam 외 arxiv

We introduce an empowered transposed Fully Connected Weighted (t-FCW) graph representation to embed point clouds into a metric space. While original t-FCW has shown promising results for point cloud classification, the r…

Point Cloud ClassificationSemantic SegmentationPoint Clouds

Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspective

2025-07-20 · Yubo Wang, Min Tang, Nuo Shen, Shujie Cui 외 arxiv

The large language model (LLM) powered recommendation paradigm has been proposed to address the limitations of traditional recommender systems, which often struggle to handle cold start users or items with new IDs. Despi…