paper-with-me

홈 › Papers

X-lifecycle Learning for Cloud Incident Management using LLMs

2024-02-15 · Drishti Goel, Fiza Husain, Aditya Singh, Supriyo Ghosh, Anjaly Parayil, Chetan Bansal, Xuchao Zhang, Saravan Rajmohan

Incident management for large cloud services is a complex and tedious process and requires significant amount of manual efforts from on-call engineers (OCEs). OCEs typically leverage data from different stages of the software development lifecycle [SDLC] (e.g., codes, configuration, monitor data, service properties, service dependencies, trouble-shooting documents, etc.) to generate insights for detection, root causing and mitigating of incidents. Recent advancements in large language models [LLMs] (e.g., ChatGPT, GPT-4, Gemini) created opportunities to automatically generate contextual recommendations to the OCEs assisting them to quickly identify and mitigate critical issues. However, existing research typically takes a silo-ed view for solving a certain task in incident management by leveraging data from a single stage of SDLC. In this paper, we demonstrate that augmenting additional contextual data from different stages of SDLC improves the performance of two critically important and practically challenging tasks: (1) automatically generating root cause recommendations for dependency failure related incidents, and (2) identifying ontology of service monitors used for automatically detecting incidents. By leveraging 353 incident and 260 monitor dataset from Microsoft, we demonstrate that augmenting contextual information from different stages of the SDLC improves the performance over State-of-The-Art methods.

📄 PDF Abstract BibTeX arXiv:2404.03662

Code (0)

등록된 구현이 없습니다.

Tasks

Management

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Exploring LLM-based Agents for Root Cause Analysis

2024-03-07 · Devjeet Roy, Xuchao Zhang, Rashi Bhave, Chetan Bansal 외

The growing complexity of cloud based software systems has resulted in incident management becoming an integral part of the software development lifecycle. Root cause analysis (RCA), a critical part of the incident manag…

DiagnosticManagementRetrieval

Xpert: Empowering Incident Management with Query Recommendations via Large Language Models

2023-12-19 · YuXuan Jiang, Chaoyun Zhang, Shilin He, Zhihao Yang 외

Large-scale cloud systems play a pivotal role in modern IT infrastructure. However, incidents occurring within these systems can lead to service disruptions and adversely affect user experience. To swiftly resolve such i…

Management

SoftNER: Mining Knowledge Graphs From Cloud Incidents

2021-01-15 · Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao 외

The move from boxed products to services and the widespread adoption of cloud computing has had a huge impact on the software development life cycle and DevOps processes. Particularly, incident management has become crit…

Cloud ComputingKnowledge GraphsManagementMulti-Task Learning+1

Rearchitecting Datacenter Lifecycle for AI: A TCO-Driven Framework

2025-09-30 · Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Ricardo Bianchini arxiv

The rapid rise of large language models (LLMs) has been driving an enormous demand for AI inference infrastructure, mainly powered by high-end GPUs. While these accelerators offer immense computational power, they incur …

Neural Knowledge Extraction From Cloud Service Incidents

2020-07-10 · Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao 외

In the last decade, two paradigm shifts have reshaped the software industry - the move from boxed products to services and the widespread adoption of cloud computing. This has had a huge impact on the software developmen…

Cloud ComputingEntity Extraction using GANManagementMulti-Task Learning+4