paper-with-me

Papers

ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data

2024-12-16 · Chengsen Wang, Qi Qi, Jingyu Wang, Haifeng Sun, Zirui Zhuang, Jinming Wu, Lei Zhang, Jianxin Liao

Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and prediction on a single dataset, and cannot adapt to different scenarios. The powered pre-trained large language model has introduced new opportunities for time series analysis. Yet, existing methods are either inefficient in training, incapable of handling textual information, or lack zero-shot forecasting capability. In this paper, we innovatively model time series as a foreign language and construct ChatTime, a unified framework for time series and text processing. As an out-of-the-box multimodal time series foundation model, ChatTime provides zero-shot forecasting capability and supports bimodal input/output for both time series and text. We design a series of experiments to verify the superior performance of ChatTime across multiple tasks and scenarios, and create four multimodal datasets to address data gaps. The experimental results demonstrate the potential and utility of ChatTime.

📄 PDF Abstract BibTeX arXiv:2412.11376

Code (1)

forestsking/chattime 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingLarge Language ModelTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Empowering Time Series Analysis with Large-Scale Multimodal Pretraining

2026-02-05 · Peng Chen, Siyuan Wang, Shiyan Hu, Xingjian Wu 외 arxiv

While existing time series foundation models primarily rely on large-scale unimodal pretraining, they lack complementary modalities to enhance time series understanding. Building multimodal foundation models is a natural…

Time Series ForecastingTime Series AnalysisAnomaly Detection

Chronicle: A Multimodal Foundation Model for Joint Language and Time Series Understanding

2026-05-18 · Paul Quinlan, Jeremy Levasseur, Qingguo Li, Xiaodan Zhu arxiv

Real-world time series come with text: metadata, descriptions, news, reports. Yet time series foundation models process numerical sequences in isolation, and the multimodal text-and-time-series models that attempt to bri…

Time Series Classification

UniCast: A Unified Framework for Instance-Conditioned Multimodal Time-Series Forecasting

2025-08-16 · Sehyuk Park, Soyeon Caren Han, Eduard Hovy arxiv

Time series forecasting underpins applications in finance, healthcare, and environmental monitoring. Despite the success of Time Series Foundation Models (TSFMs), existing approaches operate in a unimodal setting and rel…

Time Series Forecasting

MLLM4TS: Leveraging Vision and Multimodal Language Models for General Time-Series Analysis

2025-10-08 · Qinghua Liu, Sam Heshmati, Zheda Mai, Zubin Abraham 외 arxiv

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect tim…

Anomaly Detection

TRACE: A Temporal Conditional Estimation for Multimodal Time Series Foundation Models

2026-06-04 · Ziwen Kan, Yishuo Chen, Kecheng Li, Andrew Wen 외 arxiv

Time series foundation models (TS-FMs) aim to learn generalizable temporal representations that can be adapted to a wide range of downstream tasks. In real-world multimodal settings, time series are frequently affected b…

Multimodal Sentiment Analysis