paper-with-me

Papers

TF-Coder: Program Synthesis for Tensor Manipulations

2020-03-19 · NeurIPS Workshop CAP 2020 12 · Kensen Shi, David Bieber, Rishabh Singh

The success and popularity of deep learning is on the rise, partially due to powerful deep learning frameworks such as TensorFlow and PyTorch that make it easier to develop deep learning models. However, these libraries also come with steep learning curves, since programming in these frameworks is quite different from traditional imperative programming with explicit loops and conditionals. In this work, we present a tool called TF-Coder for programming by example in TensorFlow. TF-Coder uses a bottom-up weighted enumerative search, with value-based pruning of equivalent expressions and flexible type- and value-based filtering to ensure that expressions adhere to various requirements imposed by the TensorFlow library. We train models to predict TensorFlow operations from features of the input and output tensors and natural language descriptions of tasks, to prioritize relevant operations during search. TF-Coder solves 63 of 70 real-world tasks within 5 minutes, sometimes finding simpler solutions in less time compared to experienced human programmers.

📄 PDF Abstract BibTeX arXiv:2003.09040

Code (2)

google-research/tensorflow-coder 공식 구현 tf
grwlf/galaxy-lang tf

Tasks

Deep LearningEnumerative SearchProgram Synthesis

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Hierarchical Neural Program Synthesis

2023-03-09 · Linghan Zhong, Ryan Lindeborg, Jesse Zhang, Joseph J. Lim 외

Program synthesis aims to automatically construct human-readable programs that satisfy given task specifications, such as input/output pairs or demonstrations. Recent works have demonstrated encouraging results in a vari…

DecoderProgram Synthesis

QiMeng-Xpiler: Transcompiling Tensor Programs for Deep Learning Systems with a Neural-Symbolic Approach

2025-05-04 · Shouyang Dong, Yuanbo Wen, Jun Bi, Di Huang 외

Heterogeneous deep learning systems (DLS) such as GPUs and ASICs have been widely deployed in industrial data centers, which requires to develop multiple low-level tensor programs for different platforms. An attractive s…

Code GenerationGPUProgram Synthesis

Natural- to formal-language generation using Tensor Product Representations

2019-09-25 · Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky 외

Generating formal-language represented by relational tuples, such as Lisp programs or mathematical expressions, from a natural-language input is an extremely challenging task because it requires to explicitly capture dis…

DecoderMathProgram SynthesisText Generation

Lossless Tensor Compression as Program Synthesis

2026-08-03 · Jieke Shi, Junda He, Wenjia Jiang, Weifeng Sun 외 hf

Model checkpoints are growing in both number and size, which makes archival, transfer, and deployment increasingly costly. General-purpose compressors can reduce storage requirements but ignore tensor structure, whereas …

Program SynthesisImage Generation

Einops: Clear and Reliable Tensor Manipulations with Einstein-like Notation

2021-09-29 · ICLR 2022 4 · Alex Rogozhnikov

Tensor computations underlie modern scientific computing and deep learning. A number of tensor frameworks emerged varying in execution model, hardware support, memory management, model definition, etc. However, available…

Management