paper-with-me

Papers

Interpretable Machine Learning for Discovery: Statistical Challenges \& Opportunities

2023-08-02 · Genevera I. Allen, Luqin Gan, Lili Zheng

New technologies have led to vast troves of large and complex datasets across many scientific domains and industries. People routinely use machine learning techniques to not only process, visualize, and make predictions from this big data, but also to make data-driven discoveries. These discoveries are often made using Interpretable Machine Learning, or machine learning models and techniques that yield human understandable insights. In this paper, we discuss and review the field of interpretable machine learning, focusing especially on the techniques as they are often employed to generate new knowledge or make discoveries from large data sets. We outline the types of discoveries that can be made using Interpretable Machine Learning in both supervised and unsupervised settings. Additionally, we focus on the grand challenge of how to validate these discoveries in a data-driven manner, which promotes trust in machine learning systems and reproducibility in science. We discuss validation from both a practical perspective, reviewing approaches based on data-splitting and stability, as well as from a theoretical perspective, reviewing statistical results on model selection consistency and uncertainty quantification via statistical inference. Finally, we conclude by highlighting open challenges in using interpretable machine learning techniques to make discoveries, including gaps between theory and practice for validating data-driven-discoveries.

📄 PDF Abstract BibTeX arXiv:2308.01475

Code (0)

등록된 구현이 없습니다.

Tasks

Interpretable Machine LearningModel SelectionUncertainty Quantification

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Algorithms and Statistical Models for Scientific Discovery in the Petabyte Era

2019-11-05 · Brian Nord, Andrew J. Connolly, Jamie Kinney, Jeremy Kubica 외

The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the…

Astronomyscientific discovery

Learning from learning machines: a new generation of AI technology to meet the needs of science

2021-11-27 · Luca Pion-Tonachini, Kristofer Bouchard, Hector Garcia Martin, Sean Peisert 외

We outline emerging opportunities and challenges to enhance the utility of AI for scientific discovery. The distinct goals of AI for industry versus the goals of AI for science create tension between identifying patterns…

scientific discovery

Causal inference in drug discovery and development

2022-09-29 · Tom Michoel, Jitao David Zhang

To discover new drugs is to seek and to prove causality. As an emerging approach leveraging human knowledge and creativity, data, and machine intelligence, causal inference holds the promise of reducing cognitive bias an…

Causal InferenceDecision MakingDrug Discovery

Neurosymbolic Programming for Science

2022-10-10 · Jennifer J. Sun, Megan Tjandrasuwita, Atharva Sehgal, Armando Solar-Lezama 외

Neurosymbolic Programming (NP) techniques have the potential to accelerate scientific discovery. These models combine neural and symbolic components to learn complex patterns and representations from data, using high-lev…

scientific discovery

On sparse regression, Lp-regularization, and automated model discovery

2023-10-09 · Jeremy A. McCulloch, Skyler R. St. Pierre, Kevin Linka, Ellen Kuhl

Sparse regression and feature extraction are the cornerstones of knowledge discovery from massive data. Their goal is to discover interpretable and predictive models that provide simple relationships among scientific var…

L2 RegularizationModel DiscoveryregressionSymbolic Regression