paper-with-me

Papers

Vertical Symbolic Regression

2023-12-19 · Nan Jiang, Md Nasim, Yexiang Xue

Automating scientific discovery has been a grand goal of Artificial Intelligence (AI) and will bring tremendous societal impact. Learning symbolic expressions from experimental data is a vital step in AI-driven scientific discovery. Despite exciting progress, most endeavors have focused on the horizontal discovery paths, i.e., they directly search for the best expression in the full hypothesis space involving all the independent variables. Horizontal paths are challenging due to the exponentially large hypothesis space involving all the independent variables. We propose Vertical Symbolic Regression (VSR) to expedite symbolic regression. The VSR starts by fitting simple expressions involving a few independent variables under controlled experiments where the remaining variables are held constant. It then extends the expressions learned in previous rounds by adding new independent variables and using new control variable experiments allowing these variables to vary. The first few steps in vertical discovery are significantly cheaper than the horizontal path, as their search is in reduced hypothesis spaces involving a small set of variables. As a consequence, vertical discovery has the potential to supercharge state-of-the-art symbolic regression approaches in handling complex equations with many contributing factors. Theoretically, we show that the search space of VSR can be exponentially smaller than that of horizontal approaches when learning a class of expressions. Experimentally, VSR outperforms several baselines in learning symbolic expressions involving many independent variables.

📄 PDF Abstract BibTeX arXiv:2312.11955

Code (0)

등록된 구현이 없습니다.

Tasks

regressionscientific discoverySymbolic Regression

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Vertical Symbolic Regression via Deep Policy Gradient

2024-02-01 · Nan Jiang, Md Nasim, Yexiang Xue

Vertical Symbolic Regression (VSR) recently has been proposed to expedite the discovery of symbolic equations with many independent variables from experimental data. VSR reduces the search spaces following the vertical d…

Decision MakingDeep Reinforcement LearningregressionSequential Decision Making+1

Towards Vertical Privacy-Preserving Symbolic Regression via Secure Multiparty Computation

2023-07-22 · Du Nguyen Duy, Michael Affenzeller, Ramin-Nikzad Langerodi

Symbolic Regression is a powerful data-driven technique that searches for mathematical expressions that explain the relationship between input variables and a target of interest. Due to its efficiency and flexibility, Ge…

Privacy PreservingregressionSymbolic Regression

Shadow of the (Hierarchical) Tree: Reconciling Symbolic and Predictive Components of the Neural Code for Syntax

2024-12-02 · Elliot Murphy

Natural language syntax can serve as a major test for how to integrate two infamously distinct frameworks: symbolic representations and connectionist neural networks. Building on a recent neurocomputational architecture …

Neural Disjunctive Normal Form: Vertically Integrating Logic With Deep Learning For Classification

2021-01-01 · Jialin Lu, Martin Ester

We present Neural Disjunctive Normal Form (Neural DNF), a hybrid neuro- symbolic classifier that vertically integrates propositional logic with a deep neural network. Here, we aim at a vertical integration of logic and d…

FormGeneral ClassificationInductive Bias

Elite Bases Regression: A Real-time Algorithm for Symbolic Regression

2017-04-24 · Chen Chen, Changtong Luo, Zonglin Jiang

Symbolic regression is an important but challenging research topic in data mining. It can detect the underlying mathematical models. Genetic programming (GP) is one of the most popular methods for symbolic regression. Ho…

regressionSymbolic Regression