paper-with-me

홈 › Papers

SoftNER: Mining Knowledge Graphs From Cloud Incidents

2021-01-15 · Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao, Nachiappan Nagappan

The move from boxed products to services and the widespread adoption of cloud computing has had a huge impact on the software development life cycle and DevOps processes. Particularly, incident management has become critical for developing and operating large-scale services. Prior work on incident management has heavily focused on the challenges with incident triaging and de-duplication. In this work, we address the fundamental problem of structured knowledge extraction from service incidents. We have built SoftNER, a framework for mining Knowledge Graphs from incident reports. First, we build a novel multi-task learning based BiLSTM-CRF model which leverages not just the semantic context but also the data-types for extracting factual information in the form of named entities. Next, we present an approach to mine relations between the named entities for automatically constructing knowledge graphs. We have deployed SoftNER at Microsoft, a major cloud service provider and have evaluated it on more than 2 months of cloud incidents. We show that the unsupervised machine learning pipeline has a high precision of 0.96. Our multi-task learning based deep learning model also outperforms the state-of-the-art NER models. Lastly, using the knowledge extracted by SoftNER, we are able to build accurate models for applications such as incident triaging and recommending entities based on their relevance to incident titles.

📄 PDF Abstract BibTeX arXiv:2101.05961

Code (0)

등록된 구현이 없습니다.

Tasks

Cloud ComputingKnowledge GraphsManagementMulti-Task LearningNER

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Neural Knowledge Extraction From Cloud Service Incidents

2020-07-10 · Manish Shetty, Chetan Bansal, Sumit Kumar, Nikitha Rao 외

In the last decade, two paradigm shifts have reshaped the software industry - the move from boxed products to services and the widespread adoption of cloud computing. This has had a huge impact on the software developmen…

Cloud ComputingEntity Extraction using GANManagementMulti-Task Learning+4

Cloud Atlas: Efficient Fault Localization for Cloud Systems using Language Models and Causal Insight

2024-07-11 · Zhiqiang Xie, Yujia Zheng, Lizi Ottens, Kun Zhang 외

Runtime failure and performance degradation is commonplace in modern cloud systems. For cloud providers, automatically determining the root cause of incidents is paramount to ensuring high reliability and availability as…

Causal DiscoveryFault localization

Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps

2022-04-21 · Amrita Saha, Steven C. H. Hoi

Root Cause Analysis (RCA) of any service-disrupting incident is one of the most critical as well as complex tasks in IT processes, especially for cloud industry leaders like Salesforce. Typically RCA investigation levera…

2kInformation RetrievalManagementRetrieval

Knowledge mining of unstructured information: application to cyber-domain

2021-09-08 · Tuomas Takko, Kunal Bhattacharya, Martti Lehto, Pertti Jalasvirta 외

Information on cyber-related crimes, incidents, and conflicts is abundantly available in numerous open online sources. However, processing the large volumes and streams of data is a challenging task for the analysts and …

Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Models

2023-01-10 · Toufique Ahmed, Supriyo Ghosh, Chetan Bansal, Thomas Zimmermann 외

Incident management for cloud services is a complex process involving several steps and has a huge impact on both service health and developer productivity. On-call engineers require significant amount of domain knowledg…

ManagementQuestion AnsweringText Summarization