UNIFERENCE: A Discrete Event Simulation Framework for Developing Distributed AI Models
Developing and evaluating distributed inference algorithms remains difficult due to the lack of standardized tools for modeling heterogeneous devices and networks. Existing studies often rely on ad-hoc testbeds or proprietary infrastructure, making results hard to reproduce and limiting exploration of hypothetical hardware or network configurations. We present UNIFERENCE, a discrete-event simulation (DES) framework designed for developing, benchmarking, and deploying distributed AI models within a unified environment. UNIFERENCE models device and network behavior through lightweight logical processes that synchronize only on communication primitives, eliminating rollbacks while preserving the causal order. It integrates seamlessly with PyTorch Distributed, enabling the same codebase to transition from simulation to real deployment. Our evaluation demonstrates that UNIFERENCE profiles runtime with up to 98.6% accuracy compared to real physical deployments across diverse backends and hardware setups. By bridging simulation and deployment, UNIFERENCE provides an accessible, reproducible platform for studying distributed inference algorithms and exploring future system designs, from high-performance clusters to edge-scale devices. The framework is open-sourced at https://github.com/Dogacel/Uniference.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Python-based Mixed Discrete-Continuous Simulation Framework for Digital Twins
The use of Digital Twins is set to transform the manufacturing sector by aiding monitoring and real-time decision making. For several applications in this sector, the system to be modeled consists of a mix of discrete-ev…
Decision MakingStochastic Event Generation Through Markovian Jumps: Generalized Distribution and Minimal Representations
Stochastic Event Timing is a fundamental issue in developing both analytic and simulation models for stochastic systems. Generalized Erlang distributions are quite useful for generating those random events in a quite gen…
Developing a Discrete-Event Simulator of School Shooter Behavior from VR Data
Virtual reality (VR) has emerged as a powerful tool for evaluating school security measures in high-risk scenarios such as school shootings, offering experimental control and high behavioral fidelity. However, assessing …
Modeling the process of speciation using a multi-scale framework including error estimates
This paper concerns the modeling and numerical simulation of the process of speciation. In particular, given conditions for which one or more speciation events within an ecosystem occur, our aim is to develop the necessa…
Resilience of international oil trade networks under extreme event shock-recovery simulations
With the frequent occurrence of black swan events, global energy security situation has become increasingly complex and severe. Assessing the resilience of the international oil trade network (iOTN) is crucial for evalua…