paper-with-me

홈 › Papers

Deep Symbolic Superoptimization Without Human Knowledge

2020-05-01 · ICLR 2020 1 · Hui Shi, Yang Zhang, Xinyun Chen, Yuandong Tian, Jishen Zhao

Deep symbolic superoptimization refers to the task of applying deep learning methods to simplify symbolic expressions. Existing approaches either perform supervised training on human-constructed datasets that defines equivalent expression pairs, or apply reinforcement learning with human-defined equivalent trans-formation actions. In short, almost all existing methods rely on human knowledge to define equivalence, which suffers from large labeling cost and learning bias, because it is almost impossible to define and comprehensive equivalent set. We thus propose HISS, a reinforcement learning framework for symbolic super-optimization that keeps human outside the loop. HISS introduces a tree-LSTM encoder-decoder network with attention to ensure tractable learning. Our experiments show that HISS can discover more simplification rules than existing human-dependent methods, and can learn meaningful embeddings for symbolic expressions, which are indicative of equivalence.

📄 PDF Abstract BibTeX

Code (1)

shihui2010/symbolic_simplifier 공식 구현 pytorch

Tasks

Decoderreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Prism: Symbolic Superoptimization of Tensor Programs

2026-04-16 · Mengdi Wu, Xiaoyu Jiang, Oded Padon, Zhihao Jia arxiv

This paper presents Prism, the first symbolic superoptimizer for tensor programs. The key idea is sGraph, a symbolic, hierarchical representation that compactly encodes large classes of tensor programs by symbolically re…

Graph Generation

Learning to superoptimize programs - Workshop Version

2016-12-04 · Rudy Bunel, Alban Desmaison, M. Pawan Kumar, Philip H. S. Torr 외

Superoptimization requires the estimation of the best program for a given computational task. In order to deal with large programs, superoptimization techniques perform a stochastic search. This involves proposing a modi…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Equality Saturation for Tensor Graph Superoptimization

2021-01-05 · Yichen Yang, Phitchaya Mangpo Phothilimtha, Yisu Remy Wang, Max Willsey 외

One of the major optimizations employed in deep learning frameworks is graph rewriting. Production frameworks rely on heuristics to decide if rewrite rules should be applied and in which order. Prior research has shown t…

Learning to Superoptimize Real-world Programs

2021-09-28 · Alex Shypula, Pengcheng Yin, Jeremy Lacomis, Claire Le Goues 외

Program optimization is the process of modifying software to execute more efficiently. Superoptimizers attempt to find the optimal program by employing significantly more expensive search and constraint solving technique…

Compiler OptimizationImitation Learning

Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents

2024-07-11 · Haoyi Xiong, Zhiyuan Wang, Xuhong LI, Jiang Bian 외

This article explores the convergence of connectionist and symbolic artificial intelligence (AI), from historical debates to contemporary advancements. Traditionally considered distinct paradigms, connectionist AI focuse…

Decision MakingKnowledge Graphs