paper-with-me

홈 › Papers

Distributed Learning and Inference Systems: A Networking Perspective

2025-01-09 · Hesham G. Moussa, Arashmid Akhavain, S. Maryam Hosseini, Bill McCormick

Machine learning models have achieved, and in some cases surpassed, human-level performance in various tasks, mainly through centralized training of static models and the use of large models stored in centralized clouds for inference. However, this centralized approach has several drawbacks, including privacy concerns, high storage demands, a single point of failure, and significant computing requirements. These challenges have driven interest in developing alternative decentralized and distributed methods for AI training and inference. Distribution introduces additional complexity, as it requires managing multiple moving parts. To address these complexities and fill a gap in the development of distributed AI systems, this work proposes a novel framework, Data and Dynamics-Aware Inference and Training Networks (DA-ITN). The different components of DA-ITN and their functions are explored, and the associated challenges and research areas are highlighted.

📄 PDF Abstract BibTeX arXiv:2501.05323

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalization Bounds of Emergent Communications for Agentic AI Networking

2026-05-09 · Yong Xiao, Jingxuan Chai, Guangming Shi, Ping Zhang arxiv

The evolution of 6G networking toward agentic AI networking (AgentNet) systems requires a shift from traditional data pipelines to task-aware, agentic AI-native communication solutions. Emergent communication, a novel co…

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game

2022-06-03 · Zhiyuan Yao, Zihan Ding

This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this pro…

FairnessManagementMulti-agent Reinforcement Learning

Two Decades of AI4NETS-AI/ML for Data Networks: Challenges & Research Directions

2020-03-03 · Pedro Casas

The popularity of Artificial Intelligence (AI) -- and of Machine Learning (ML) as an approach to AI, has dramatically increased in the last few years, due to its outstanding performance in various domains, notably in ima…

ACCL+: an FPGA-Based Collective Engine for Distributed Applications

2023-12-18 · Zhenhao He, Dario Korolija, Yu Zhu, Benjamin Ramhorst 외

FPGAs are increasingly prevalent in cloud deployments, serving as Smart NICs or network-attached accelerators. Despite their potential, developing distributed FPGA-accelerated applications remains cumbersome due to the l…

CPU

Synchronization Strategies for Multi-agent Networked Control Systems

2021-07-04 · Pratik K. Bajaria

With the advent of 21st century and increasing advancements in the field of technology and connectivity, inter-networking in real-time has achieved great importance. Distributed control and multi-agent paradigm has grope…