paper-with-me

Papers

A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph

2025-03-10 · Shule Hao, Junpeng Bao, Chuncheng Lu

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel time series multitask framework, called LTM, which integrates temporal features with textual descriptions to enhance analytical and predictive capabilities. LTM combines pre-trained time series model, large language model (LLM), and knowledge graph to tackle time series tasks, including forecasting, imputation, and anomaly detection. LTM achieves improved performance with a few trainable parameters. It is very efficient and practical. LTM encodes time series data into patches and enriches user-provided prompts using knowledge graphs to generate enhanced prompts. A novel feature fusion method embeds prompts into each patch encoding, which is processed by a frozen LLM, followed by a feature enhancement module and a time decoder module. During fine-tuning stage, cosine similarity between prompts and temporal patches is integrated into the loss function to boost performance. Experiments on benchmark datasets show that LTM significantly outperforms existing methods. It provides a robust and versatile solution for time series tasks.

📄 PDF Abstract BibTeX arXiv:2503.07682

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDecoderImputationKnowledge GraphsLanguage ModelingLanguage ModellingLarge Language ModelmodelTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

ITFormer: Bridging Time Series and Natural Language for Multi-Modal QA with Large-Scale Multitask Dataset

2025-06-25 · Yilin Wang, Peixuan Lei, Jie Song, Yuzhe Hao 외

Time-series data are critical in diverse applications, such as industrial monitoring, medical diagnostics, and climate research. However, effectively integrating these high-dimensional temporal signals with natural langu…

Computational EfficiencyQuestion AnsweringTime Series

Massively Multitask Networks for Drug Discovery

2015-02-06 · Bharath Ramsundar, Steven Kearnes, Patrick Riley, Dale Webster 외

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts …

Drug Discovery

OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning

2024-01-01 · CVPR 2024 1 · Siddharth Srivastava, Gaurav Sharma

We present a novel multimodal multitask network and associated training algorithm. The method is capable of ingesting data from approximately 12 different modalities namely image video audio text depth point cloud ti…

3D Point Cloud ClassificationAction ClassificationAction RecognitionAudio Classification+6

OmniVec2 -- A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning

2025-07-06 · Siddharth Srivastava, Gaurav Sharma arxiv

We present a novel multimodal multitask network and associated training algorithm. The method is capable of ingesting data from approximately 12 different modalities namely image, video, audio, text, depth, point cloud, …

Integrating Contrastive Learning into a Multitask Transformer Model for Effective Domain Adaptation

2023-10-07 · Chung-Soo Ahn, Jagath C. Rajapakse, Rajib Rana

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a m…

Contrastive LearningCross-corpusDomain AdaptationEmotion Recognition+1