DiSciPLE: Learning Interpretable Programs for Scientific Visual Discovery
Visual data is used in numerous different scientific workflows ranging from remote sensing to ecology. As the amount of observation data increases, the challenge is not just to make accurate predictions but also to understand the underlying mechanisms for those predictions. Good interpretation is important in scientific workflows, as it allows for better decision-making by providing insights into the data. This paper introduces an automatic way of obtaining such interpretable-by-design models, by learning programs that interleave neural networks. We propose DiSciPLE (Discovering Scientific Programs using LLMs and Evolution) an evolutionary algorithm that leverages common sense and prior knowledge of large language models (LLMs) to create Python programs explaining visual data. Additionally, we propose two improvements: a program critic and a program simplifier to improve our method further to synthesize good programs. On three different real world problems, DiSciPLE learns state-of-the-art programs on novel tasks with no prior literature. For example, we can learn programs with 35% lower error than the closest non-interpretable baseline for population density estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningDensity EstimationSimilar Papers 제목 키워드 기반
Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discovery
Symbolic Regression (SR) aims to discover interpretable equations from observational data, with the potential to reveal underlying principles behind natural phenomena. However, existing approaches often fall into the Pse…
A Field Guide to Scientific XAI: Transparent and Interpretable Deep Learning for Bioinformatics Research
Deep learning has become popular because of its potential to achieve high accuracy in prediction tasks. However, accuracy is not always the only goal of statistical modelling, especially for models developed as part of s…
Deep LearningExplainable Artificial Intelligence (XAI)scientific discoveryBenchmarking the Discovery Engine
The Discovery Engine is a general purpose automated system for scientific discovery, which combines machine learning with state-of-the-art ML interpretability to enable rapid and robust scientific insight across diverse …
Boolean matrix logic programming for active learning of gene functions in genome-scale metabolic network models
Reasoning about hypotheses and updating knowledge through empirical observations are central to scientific discovery. In this work, we applied logic-based machine learning methods to drive biological discovery by guiding…
Active LearningExperimental Designscientific discoverySynthesizing Interpretable Control Policies through Large Language Model Guided Search
The combination of Large Language Models (LLMs), systematic evaluation, and evolutionary algorithms has enabled breakthroughs in combinatorial optimization and scientific discovery. We propose to extend this powerful com…
Combinatorial OptimizationEvolutionary AlgorithmsLanguage ModelingLanguage Modelling+2