Scientific Inference With Interpretable Machine Learning: Analyzing Models to Learn About Real-World Phenomena
To learn about real world phenomena, scientists have traditionally used models with clearly interpretable elements. However, modern machine learning (ML) models, while powerful predictors, lack this direct elementwise interpretability (e.g. neural network weights). Interpretable machine learning (IML) offers a solution by analyzing models holistically to derive interpretations. Yet, current IML research is focused on auditing ML models rather than leveraging them for scientific inference. Our work bridges this gap, presenting a framework for designing IML methods-termed 'property descriptors' -- that illuminate not just the model, but also the phenomenon it represents. We demonstrate that property descriptors, grounded in statistical learning theory, can effectively reveal relevant properties of the joint probability distribution of the observational data. We identify existing IML methods suited for scientific inference and provide a guide for developing new descriptors with quantified epistemic uncertainty. Our framework empowers scientists to harness ML models for inference, and provides directions for future IML research to support scientific understanding.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningInterpretable Machine LearningLearning TheorySimilar Papers 제목 키워드 기반
Interpretable Machine Learning in Physics: A Review
Machine learning is increasingly transforming various scientific fields, enabled by advancements in computational power and access to large data sets from experiments and simulations. As artificial intelligence (AI) cont…
Interpretable Machine Learningscientific discoveryDecontextualized learning for interpretable hierarchical representations of visual patterns
Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particular…
Image Generationobject-detectionRepresentation LearningUncertainty Quantification for Scientific Machine Learning using Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)
Kolmogorov-Arnold Networks have emerged as interpretable alternatives to traditional multi-layer perceptrons. However, standard implementations lack principled uncertainty quantification capabilities essential for many s…
Out-of-Distribution DetectionBayesian InferenceInterpretable Machine Learning for Discovery: Statistical Challenges \& Opportunities
New technologies have led to vast troves of large and complex datasets across many scientific domains and industries. People routinely use machine learning techniques to not only process, visualize, and make predictions …
Interpretable Machine LearningModel SelectionUncertainty QuantificationA Scalable Inference Method For Large Dynamic Economic Systems
The nature of available economic data has changed fundamentally in the last decade due to the economy's digitisation. With the prevalence of often black box data-driven machine learning methods, there is a necessity to d…
Bayesian InferenceBIG-bench Machine LearningInterpretable Machine Learning