paper-with-me

Papers

BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting

2025-08-30 · Shiqiao Zhou, Holger Schöner, Huanbo Lyu, Edouard Fouché, Shuo Wang arxiv

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward harnessing textual modalities to enhance forecasting performance. However, the vast discrepancy between text and temporal data often leads current multimodal architectures to over-emphasise one modality while neglecting the other, resulting in information loss that harms forecasting performance. To address this modality imbalance, we introduce BALM-TSF (Balanced Multimodal Alignment for LLM-Based Time Series Forecasting), a lightweight time series forecasting framework that maintains balance between the two modalities. Specifically, raw time series are processed by the time series encoder, while descriptive statistics of raw time series are fed to an LLM with learnable prompt, producing compact textual embeddings. To ensure balanced cross-modal context alignment of time series and textual embeddings, a simple yet effective scaling strategy combined with a contrastive objective then maps these textual embeddings into the latent space of the time series embeddings. Finally, the aligned textual semantic embeddings and time series embeddings are together integrated for forecasting. Extensive experiments on standard benchmarks show that, with minimal trainable parameters, BALM-TSF achieves state-of-the-art performance in both long-term and few-shot forecasting, confirming its ability to harness complementary information from text and time series. Code is available at https://github.com/ShiqiaoZhou/BALM-TSF.

📄 PDF Abstract BibTeX arXiv:2509.00622

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series Forecasting

Similar Papers 제목 키워드 기반

BALM: A Model-Agnostic Framework for Balanced Multimodal Learning under Imbalanced Missing Rates

2026-03-20 · Phuong-Anh Nguyen, Tien Anh Pham, Duc-Trong Le, Cam-Van Thi Nguyen arxiv

Learning from multiple modalities often suffers from imbalance, where information-rich modalities dominate optimization while weaker or partially missing modalities contribute less. This imbalance becomes severe in reali…

Multimodal Emotion RecognitionRepresentation Learning

Class Balancing Diversity Multimodal Ensemble for Alzheimer's Disease Diagnosis and Early Detection

2024-10-14 · Arianna Francesconi, Lazzaro di Biase, Donato Cappetta, Fabio Rebecchi 외

Alzheimer's disease (AD) poses significant global health challenges due to its increasing prevalence and associated societal costs. Early detection and diagnosis of AD are critical for delaying progression and improving …

DiagnosticDiversity

GlobalMood: A cross-cultural benchmark for music emotion recognition

2025-05-14 · Harin Lee, Elif Çelen, Peter Harrison, Manuel Anglada-Tort 외

Human annotations of mood in music are essential for music generation and recommender systems. However, existing datasets predominantly focus on Western songs with mood terms derived from English, which may limit general…

Emotion RecognitionMusic Emotion RecognitionMusic GenerationRecommendation Systems+1

PATRA: Pattern-Aware Alignment and Balanced Reasoning for Time Series Question Answering

2026-02-26 · Junkai Lu, Peng Chen, Xingjian Wu, Yang Shu 외 arxiv

Time series reasoning demands both the perception of complex dynamics and logical depth. However, existing LLM-based approaches exhibit two limitations: they often treat time series merely as text or images, failing to c…

Question Answering

GlobalMamba: Global Image Serialization for Vision Mamba

2024-10-14 · Chengkun Wang, Wenzhao Zheng, Jie zhou, Jiwen Lu

Vision mambas have demonstrated strong performance with linear complexity to the number of vision tokens. Their efficiency results from processing image tokens sequentially. However, most existing methods employ patch-ba…

image-classificationImage ClassificationMambaobject-detection+2