paper-with-me

홈 › Papers

On the Robustness of Deep Learning-predicted Contention Models for Network Calculus

2019-11-24 · Fabien Geyer, Steffen Bondorf

The network calculus (NC) analysis takes a simple model consisting of a network of schedulers and data flows crossing them. A number of analysis "building blocks" can then be applied to capture the model without imposing pessimistic assumptions like self-contention on tandems of servers. Yet, adding pessimism cannot always be avoided. To compute the best bound on a single flow's end-to-end delay thus boils down to finding the least pessimistic contention models for all tandems of schedulers in the network - and an exhaustive search can easily become a very resource intensive task. The literature proposes a promising solution to this dilemma: a heuristic making use of machine learning (ML) predictions inside the NC analysis. While results of this work were promising in terms of delay bound quality and computational effort, there is little to no insight on when a prediction is made or if the trained algorithm can achieve similarly striking results in networks vastly differing from its training data. In this paper, we address these pending questions. We evaluate the influence of the training data and its features on accuracy, impact and scalability. Additionally, we contribute an extension of the method by predicting the best $n$ contention model alternatives in order to achieve increased robustness for its application outside the training data. Our numerical evaluation shows that good accuracy can still be achieved on large networks although we restrict the training to networks that are two orders of magnitude smaller.

📄 PDF Abstract BibTeX arXiv:1911.10522

Code (1)

fabgeyer/dataset-deeptma-extension 공식 구현

Similar Papers 제목 키워드 기반

Network Contention-Aware Cluster Scheduling with Reinforcement Learning

2023-10-31 · Junyeol Ryu, Jeongyoon Eo

With continuous advances in deep learning, distributed training is becoming common in GPU clusters. Specifically, for emerging workloads with diverse amounts, ratios, and patterns of communication, we observe that networ…

GPUreinforcement-learningReinforcement LearningScheduling

Is Climate Change Controversial? Modeling Controversy as Contention Within Populations

2017-03-29 · Dori-Hacohen Shiri, Jang Myungha, Allan James

A growing body of research focuses on computationally detecting controversial topics and understanding the stances people hold on them. Yet gaps remain in our theoretical and practical understanding of how to define cont…

Graph-Structured Deep Learning Framework for Multi-task Contention Identification with High-dimensional Metrics

2026-01-28 · Xiao Yang, Yinan Ni, Yuqi Tang, Zhimin Qiu 외 arxiv

This study addresses the challenge of accurately identifying multi-task contention types in high-dimensional system environments and proposes a unified contention classification framework that integrates representation t…

LSTM-ACB-Based RA for IoT Mixed Traffic

2023-03-02 · Herman L. dos Santos, José Carlos Marinello, Cristiano Magalhaes Panazio, Taufik Abrão

A novel random access (RA) scheme for mixed URLLC-mMTC traffic scenario is proposed using realistic statistical models, with the use mode presenting long-term traffic regularity. The traffic is predicted by a long short-…

Communication Contention Aware Scheduling of Multiple Deep Learning Training Jobs

2020-02-24 · Qiang Wang, Shaohuai Shi, Canhui Wang, Xiaowen Chu

Distributed Deep Learning (DDL) has rapidly grown its popularity since it helps boost the training performance on high-performance GPU clusters. Efficient job scheduling is indispensable to maximize the overall performan…

Deep LearningGPUScheduling