Symbolic Expression Transformer: A Computer Vision Approach for Symbolic Regression

2022-05-24 · Jiachen Li, Ye Yuan, Hong-Bin Shen

Symbolic Regression (SR) is a type of regression analysis to automatically find the mathematical expression that best fits the data. Currently, SR still basically relies on various searching strategies so that a sample-specific model is required to be optimized for every expression, which significantly limits the model's generalization and efficiency. Inspired by the fact that human beings can infer a mathematical expression based on the curve of it, we propose Symbolic Expression Transformer (SET), a sample-agnostic model from the perspective of computer vision for SR. Specifically, the collected data is represented as images and an image caption model is employed for translating images to symbolic expressions. A large-scale dataset without overlap between training and testing sets in the image domain is released. Our results demonstrate the effectiveness of SET and suggest the promising direction of image-based model for solving the challenging SR problem.

📄 PDF Abstract BibTeX arXiv:2205.11798

Code (0)

등록된 구현이 없습니다.

Tasks

regressionSymbolic Regression

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

CALT: A Library for Computer Algebra with Transformer

2025-06-10 · Hiroshi Kera, Shun Arakawa, Yuta Sato

Recent advances in artificial intelligence have demonstrated the learnability of symbolic computation through end-to-end deep learning. Given a sufficient number of examples of symbolic expressions before and after the t…

Deep Learning

SymbolicGPT: A Generative Transformer Model for Symbolic Regression

2021-06-27 · Mojtaba Valipour, Bowen You, Maysum Panju, Ali Ghodsi

Symbolic regression is the task of identifying a mathematical expression that best fits a provided dataset of input and output values. Due to the richness of the space of mathematical expressions, symbolic regression is …

Language Modeling Language Modelling model regression+1

AutoVSR: Automatic Visual-to-Symbolic Reasoning for Symbolic Expression Generation from Circuit Schematic

2026-07-13 · Zhe Xiao, Longfei Li, Xu He, Haoying Wu 외 arxiv

Symbolic expressions can effectively characterize and predict circuit behavior, but deriving them directly from circuit schematics is challenging. This process requires accurate visual-to-symbolic construction of circuit…

Computational Efficiency

UniSymNet: A Unified Symbolic Network Guided by Transformer

2025-05-09 · Xinxin Li, Juan Zhang, Da Li, Xingyu Liu 외

Symbolic Regression (SR) is a powerful technique for automatically discovering mathematical expressions from input data. Mainstream SR algorithms search for the optimal symbolic tree in a vast function space, but the inc…

Symbolic Regression

SymPlex: A Structure-Aware Transformer for Symbolic PDE Solving

2026-02-03 · Yesom Park, Annie C. Lu, Shao-Ching Huang, Qiyang Hu 외 arxiv

We propose SymPlex, a reinforcement learning framework for discovering analytical symbolic solutions to partial differential equations (PDEs) without access to ground-truth expressions. SymPlex formulates symbolic PDE so…

Reinforcement Learning