TF-Replicator: Distributed Machine Learning for Researchers
We describe TF-Replicator, a framework for distributed machine learning designed for DeepMind researchers and implemented as an abstraction over TensorFlow. TF-Replicator simplifies writing data-parallel and model-parallel research code. The same models can be effortlessly deployed to different cluster architectures (i.e. one or many machines containing CPUs, GPUs or TPU accelerators) using synchronous or asynchronous training regimes. To demonstrate the generality and scalability of TF-Replicator, we implement and benchmark three very different models: (1) A ResNet-50 for ImageNet classification, (2) a SN-GAN for class-conditional ImageNet image generation, and (3) a D4PG reinforcement learning agent for continuous control. Our results show strong scalability performance without demanding any distributed systems expertise of the user. The TF-Replicator programming model will be open-sourced as part of TensorFlow 2.0 (see https://github.com/tensorflow/community/pull/25).
Code (1)
Tasks
BIG-bench Machine Learningcontinuous-controlContinuous ControlImage GenerationReinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Solutions with a bounded support promote permanence of a distributed replicator equation
The now classical replicator equation describes a wide variety of biological phenomena, including those in theoretical genetics, evolutionary game theory, or in the theories of the origin of life. Among other questions, …
Intrinsic noise in structured replicator dynamics modelling time delays
We construct and analyze structured replicator dynamics of the Snowdrift game. In our model, the offspring is put in juvenile compartments and then mature and join adult compartments with strategy-dependent rates. This i…
Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interaction
The fields of Origin of Life and Artificial Life both question what life is and how it emerges from a distinct set of "pre-life" dynamics. One common feature of most substrates where life emerges is a marked shift in dyn…
Artificial LifeReplicator Equation: Applications Revisited
The replicator equation is a simple model of evolution that leads to stable form of Nash Equilibrium, Evolutionary Stable Strategy (ESS). It has been studied in connection with Evolutionary Game Theory and was originally…
BIG-bench Machine LearningA Finite Population Destroys a Traveling Wave in Spatial Replicator Dynamics
We derive both the finite and infinite population spatial replicator dynamics as the fluid limit of a stochastic cellular automaton. The infinite population spatial replicator is identical to the model used by Vickers an…