paper-with-me

홈 › Papers

Bridging Temporal and Textual Modalities: A Multimodal Framework for Automated Cloud Failure Root Cause Analysis

2026-01-08 · Gijun Park arxiv

Root cause analysis in modern cloud infrastructure demands sophisticated understanding of heterogeneous data sources, particularly time-series performance metrics that involve core failure signatures. While large language models demonstrate remarkable capabilities in textual reasoning, their discrete token-based architecture creates fundamental incompatibilities with continuous numerical sequences exhibiting temporal dependencies. Current methodologies inadequately address this modality mismatch, constraining the potential of language model-driven automation in incident management workflows. This paper presents a multimodal diagnostic framework that harmonizes time-series representations with pretrained language model embedding spaces. Our approach contributes three technical advances: (1) a semantic compression technique that distills temporal segments into single-token abstractions while preserving pattern semantics, (2) an alignment encoder utilizing gated cross-attention to project time-series features into language model latent space, and (3) a retrieval-augmented diagnostic pipeline that synthesizes aligned embeddings with historical incident knowledge for expert-level failure attribution. Comprehensive evaluation across six cloud system benchmarks demonstrates that our framework achieves leading performance, reaching 48.75% diagnostic accuracy with notable improvements on scenarios involving compound failure modes. The results validate embedding-space alignment as an effective strategy for enabling language models to reason over multimodal telemetry data in production incident response contexts.

📄 PDF Abstract BibTeX arXiv:2601.04709

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting

2025-02-06 · Siru Zhong, Weilin Ruan, Ming Jin, Huan Li 외

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal detail…

Time SeriesTime Series Forecasting

Bridging the Gap Between Multimodal Foundation Models and World Models

2025-10-04 · Xuehai He arxiv

Humans understand the world through the integration of multiple sensory modalities, enabling them to perceive, reason about, and imagine dynamic physical processes. Inspired by this capability, multimodal foundation mode…

Causal Inference

From Text to Forecasts: Bridging Modality Gap with Temporal Evolution Semantic Space

2026-03-13 · Lehui Li, Yuyao Wang, Jisheng Yan, Wei Zhang 외 arxiv

Incorporating textual information into time-series forecasting holds promise for addressing event-driven non-stationarity; however, a fundamental modality gap hinders effective fusion: textual descriptions express tempor…

ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Data

2025-05-15 · Chengsen Wang, Qi Qi, Zhongwen Rao, Lujia Pan 외

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demons…

Language ModelingLanguage ModellingLarge Language Modelmodel+2

OmniCaptioner: One Captioner to Rule Them All

2025-04-09 · Yiting Lu, Jiakang Yuan, Zhen Li, Shitian Zhao 외

We propose OmniCaptioner, a versatile visual captioning framework for generating fine-grained textual descriptions across a wide variety of visual domains. Unlike prior methods limited to specific image types (e.g., natu…

AllImage CaptioningImage GenerationText to Image Generation+2