paper-with-me

홈 › Papers

Time Series Language Model for Descriptive Caption Generation

2025-01-03 · Mohamed Trabelsi, Aidan Boyd, Jin Cao, Huseyin Uzunalioglu

The automatic generation of representative natural language descriptions for observable patterns in time series data enhances interpretability, simplifies analysis and increases cross-domain utility of temporal data. While pre-trained foundation models have made considerable progress in natural language processing (NLP) and computer vision (CV), their application to time series analysis has been hindered by data scarcity. Although several large language model (LLM)-based methods have been proposed for time series forecasting, time series captioning is under-explored in the context of LLMs. In this paper, we introduce TSLM, a novel time series language model designed specifically for time series captioning. TSLM operates as an encoder-decoder model, leveraging both text prompts and time series data representations to capture subtle temporal patterns across multiple phases and generate precise textual descriptions of time series inputs. TSLM addresses the data scarcity problem in time series captioning by first leveraging an in-context prompting synthetic data generation, and second denoising the generated data via a novel cross-modal dense retrieval scoring applied to time series-caption pairs. Experimental findings on various time series captioning datasets demonstrate that TSLM outperforms existing state-of-the-art approaches from multiple data modalities by a significant margin.

📄 PDF Abstract BibTeX arXiv:2501.01832

Code (0)

등록된 구현이 없습니다.

Tasks

Caption GenerationDenoisingDescriptiveLanguage ModelingLanguage ModellingLarge Language ModelmodelSynthetic Data GenerationTime SeriesTime Series AnalysisTime Series Forecasting

Similar Papers 제목 키워드 기반

Domain-Independent Automatic Generation of Descriptive Texts for Time-Series Data

2024-09-25 · Kota Dohi, Aoi Ito, Harsh Purohit, Tomoya Nishida 외

Due to scarcity of time-series data annotated with descriptive texts, training a model to generate descriptive texts for time-series data is challenging. In this study, we propose a method to systematically generate doma…

Contrastive LearningDescriptiveTime Series

Enhancing Descriptive Image Captioning with Natural Language Inference

2021-08-01 · ACL 2021 5 · Zhan Shi, Hui Liu, Xiaodan Zhu

Generating \textit{descriptive} sentences that convey non-trivial, detailed, and salient information about images is an important goal of image captioning. In this paper we propose a novel approach to encourage captionin…

DescriptiveImage CaptioningNatural Language Inference

CIC: A Framework for Culturally-Aware Image Captioning

2024-02-08 · Youngsik Yun, Jihie Kim

Image Captioning generates descriptive sentences from images using Vision-Language Pre-trained models (VLPs) such as BLIP, which has improved greatly. However, current methods lack the generation of detailed descriptive …

DescriptiveImage CaptioningQuestion AnsweringVisual Question Answering+1

From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment

2024-06-20 · Yusuke Hirota, Ryo Hachiuma, Chao-Han Huck Yang, Yuta Nakashima

Large language models (LLMs) have enhanced the capacity of vision-language models to caption visual text. This generative approach to image caption enrichment further makes textual captions more descriptive, improving al…

DescriptiveHallucination

CoordSpeaker: Exploiting Gesture Captioning for Coordinated Caption-Empowered Co-Speech Gesture Generation

2025-11-28 · Fengyi Fang, Sicheng Yang, Wenming Yang arxiv

Co-speech gesture generation has significantly advanced human-computer interaction, yet speaker movements remain constrained due to the omission of text-driven non-spontaneous gestures (e.g., bowing while talking). Exist…

Gesture Generation