DOPPLER: Dual-Policy Learning for Device Assignment in Asynchronous Dataflow Graphs
We study the problem of assigning operations in a dataflow graph to devices to minimize execution time in a work-conserving system, with emphasis on complex machine learning workloads. Prior learning-based methods often struggle due to three key limitations: (1) reliance on bulk-synchronous systems like TensorFlow, which under-utilize devices due to barrier synchronization; (2) lack of awareness of the scheduling mechanism of underlying systems when designing learning-based methods; and (3) exclusive dependence on reinforcement learning, ignoring the structure of effective heuristics designed by experts. In this paper, we propose \textsc{Doppler}, a three-stage framework for training dual-policy networks consisting of 1) a $\mathsf{SEL}$ policy for selecting operations and 2) a $\mathsf{PLC}$ policy for placing chosen operations on devices. Our experiments show that \textsc{Doppler} outperforms all baseline methods across tasks by reducing system execution time and additionally demonstrates sampling efficiency by reducing per-episode training time.
Code (0)
등록된 구현이 없습니다.
Tasks
SchedulingSimilar Papers 제목 키워드 기반
Bistatic Doppler Frequency Estimation with Asynchronous Moving Devices for Integrated Sensing and Communications
In this letter, we present for the first time a method to estimate the bistatic Doppler frequency of a target with clock asynchronous and mobile Integrated Sensing And Communication (ISAC) devices. Existing approaches ha…
Integrated sensing and communicationISACAsyMov: Integrated Sensing and Communications with Asynchronous Moving Devices
Estimating the Doppler frequency shift caused by moving targets is one of the key objectives of Integrated Sensing And Communication (ISAC) systems. In the case of Wi-Fi sensing, a reliable estimation of the Doppler enab…
Activity RecognitionHuman Activity RecognitionIntegrated sensing and communicationISACMovISAC: Coherent Imaging of Moving Targets with Distributed Asynchronous ISAC Devices
Distributed integrated sensing and communication (ISAC) devices can overcome the traditional resolution limitations imposed by the signal bandwidth, cooperating to produce high-resolution images of the environment. Howev…
Integrated sensing and communicationISACDual-Gated Epistemic Time-Dilation: Autonomous Compute Modulation in Asynchronous MARL
While Multi-Agent Reinforcement Learning (MARL) algorithms achieve unprecedented successes across complex continuous domains, their standard deployment strictly adheres to a synchronous operational paradigm. Under this p…
Multi-agent Reinforcement LearningRTPO: Reverse-Turn Policy Optimization for Stabilizing Agentic RL Training
Training multi-turn agentic workflows with reinforcement learning (RL) enables large language models to perform complex reasoning, use external tools, and conduct iterative search beyond single-turn settings. Yet multi-t…
Reinforcement Learning