paper-with-me

홈 › Papers

Torch.fx: Practical Program Capture and Transformation for Deep Learning in Python

2021-12-15 · James K. Reed, Zachary DeVito, Horace He, Ansley Ussery, Jason Ansel

Modern deep learning frameworks provide imperative, eager execution programming interfaces embedded in Python to provide a productive development experience. However, deep learning practitioners sometimes need to capture and transform program structure for performance optimization, visualization, analysis, and hardware integration. We study the different designs for program capture and transformation used in deep learning. By designing for typical deep learning use cases rather than long tail ones, it is possible to create a simpler framework for program capture and transformation. We apply this principle in torch.fx, a program capture and transformation library for PyTorch written entirely in Python and optimized for high developer productivity by ML practitioners. We present case studies showing how torch.fx enables workflows previously inaccessible in the PyTorch ecosystem.

📄 PDF Abstract BibTeX arXiv:2112.08429

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

GraphMend: Code Transformations for Fixing Graph Breaks in PyTorch 2

2025-09-17 · Savini Kashmira, Jayanaka Dantanarayana, Thamirawaran Sathiyalogeswaran, Krisztian Flautner 외 arxiv

This paper presents GraphMend, a compiler technique that automatically fixes FX graph breaks in PyTorch 2 programs. Although PyTorch 2 introduced TorchDynamo and TorchInductor to enable just-in-time graph compilation, ce…

Equinox: neural networks in JAX via callable PyTrees and filtered transformations

2021-10-30 · Patrick Kidger, Cristian Garcia

JAX and PyTorch are two popular Python autodifferentiation frameworks. JAX is based around pure functions and functional programming. PyTorch has popularised the use of an object-oriented (OO) class-based syntax for defi…

TorchBeast: A PyTorch Platform for Distributed RL

2019-10-08 · Heinrich Küttler, Nantas Nardelli, Thibaut Lavril, Marco Selvatici 외

TorchBeast is a platform for reinforcement learning (RL) research in PyTorch. It implements a version of the popular IMPALA algorithm for fast, asynchronous, parallel training of RL agents. Additionally, TorchBeast has s…

OpenAI GymReinforcement LearningReinforcement Learning (RL)

PyTorch Hyperparameter Tuning - A Tutorial for spotPython

2023-05-19 · Thomas Bartz-Beielstein

The goal of hyperparameter tuning (or hyperparameter optimization) is to optimize the hyperparameters to improve the performance of the machine or deep learning model. spotPython (``Sequential Parameter Optimization Tool…

Hyperparameter Optimization

Using Python for Model Inference in Deep Learning

2021-04-01 · Zachary DeVito, Jason Ansel, Will Constable, Michael Suo 외

Python has become the de-facto language for training deep neural networks, coupling a large suite of scientific computing libraries with efficient libraries for tensor computation such as PyTorch or TensorFlow. However, …

Deep LearningmodelModel extraction