Does Distributed Training Undermine Compute Governance?
Compute governance proposals often rely on the assumption that frontier AI training requires large, detectable computing clusters. However, recent advances in distributed training algorithms could allow developers to conduct frontier-scale training on distributed agglomerations of hardware, rather than needing large datacenter facilities. Developers who prefer not to be constrained by regulations may structure their hardware in a manner that evades the registration and monitoring requirements associated with compute governance. Therefore, regulations must be designed to detect and prevent illicit distributed training operations. This paper evaluates the feasibility of such evasion and outlines recommended countermeasures, including whistleblowing, chip tracking, forensic accounting, and memory and compute thresholds for clusters.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Comprehensive AI governance requires addressing non-model gains
Frontier AI governance often centres on the model-level governance paradigm, which assumes that a model's capability profile is primarily a function of the compute and data used during training. This position paper argue…
Continual LearningDistributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape
Advances in low-communication training algorithms are enabling a shift from centralised model training to compute setups that are either distributed across multiple clusters or decentralised via community-driven contribu…
Governance-as-a-Service: A Multi-Agent Framework for AI System Compliance and Policy Enforcement
As AI systems evolve into distributed ecosystems with autonomous execution, asynchronous reasoning, and multi-agent coordination, the absence of scalable, decoupled governance poses a structural risk. Existing oversight …
The Open-Weight Paradox: Why Restricting Access to AI Models May Undermine the Safety It Seeks to Protect
The governance of open-weight artificial intelligence (AI) models has been framed as a binary choice: openness as risk, restriction as safety. This paper challenges that framing, arguing that access restrictions, without…
Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance
As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for M…
Multi-agent Reinforcement LearningPrivacy PreservingReinforcement Learning (RL)Scheduling