Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges
We present a brief history of the field of interpretable machine learning (IML), give an overview of state-of-the-art interpretation methods, and discuss challenges. Research in IML has boomed in recent years. As young as the field is, it has over 200 years old roots in regression modeling and rule-based machine learning, starting in the 1960s. Recently, many new IML methods have been proposed, many of them model-agnostic, but also interpretation techniques specific to deep learning and tree-based ensembles. IML methods either directly analyze model components, study sensitivity to input perturbations, or analyze local or global surrogate approximations of the ML model. The field approaches a state of readiness and stability, with many methods not only proposed in research, but also implemented in open-source software. But many important challenges remain for IML, such as dealing with dependent features, causal interpretation, and uncertainty estimation, which need to be resolved for its successful application to scientific problems. A further challenge is a missing rigorous definition of interpretability, which is accepted by the community. To address the challenges and advance the field, we urge to recall our roots of interpretable, data-driven modeling in statistics and (rule-based) ML, but also to consider other areas such as sensitivity analysis, causal inference, and the social sciences.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningCausal InferenceInterpretable Machine LearningSensitivitySimilar Papers 제목 키워드 기반
Explaining a black-box using Deep Variational Information Bottleneck Approach
Interpretable machine learning has gained much attention recently. Briefness and comprehensiveness are necessary in order to provide a large amount of information concisely when explaining a black-box decision system. Ho…
BIG-bench Machine LearningInterpretable Machine LearningExplaining A Black-box By Using A Deep Variational Information Bottleneck Approach
Interpretable machine learning has gained much attention recently. Briefness and comprehensiveness are necessary in order to provide a large amount of information concisely when explaining a black-box decision system. H…
BIG-bench Machine LearningInterpretable Machine LearningHow Should We Represent History in Interpretable Models of Clinical Policies?
Modeling policies for sequential clinical decision-making based on observational data is useful for describing treatment practices, standardizing frequent patterns in treatment, and evaluating alternative policies. For e…
Decision MakingRepresentation LearningSequential Decision MakingSafe and Interpretable Estimation of Optimal Treatment Regimes
Recent statistical and reinforcement learning methods have significantly advanced patient care strategies. However, these approaches face substantial challenges in high-stakes contexts, including missing data, inherent s…
Deep Neural Networks - A Brief History
Introduction to deep neural networks and their history.