Structural Neural Additive Models: Enhanced Interpretable Machine Learning
Deep neural networks (DNNs) have shown exceptional performances in a wide range of tasks and have become the go-to method for problems requiring high-level predictive power. There has been extensive research on how DNNs arrive at their decisions, however, the inherently uninterpretable networks remain up to this day mostly unobservable "black boxes". In recent years, the field has seen a push towards interpretable neural networks, such as the visually interpretable Neural Additive Models (NAMs). We propose a further step into the direction of intelligibility beyond the mere visualization of feature effects and propose Structural Neural Additive Models (SNAMs). A modeling framework that combines classical and clearly interpretable statistical methods with the predictive power of neural applications. Our experiments validate the predictive performances of SNAMs. The proposed framework performs comparable to state-of-the-art fully connected DNNs and we show that SNAMs can even outperform NAMs while remaining inherently more interpretable.
Code (1)
Tasks
Additive modelsInterpretable Machine LearningSimilar Papers 제목 키워드 기반
GRAND-SLAMIN’ Interpretable Additive Modeling with Structural Constraints
Generalized Additive Models (GAMs) are a family of flexible and interpretable models with old roots in statistics. GAMs are often used with pairwise interactions to improve model accuracy while still retaining flexibilit…
Beyond Additive Decompositions: Interpretability Through Separability
Interpretable machine learning requires models that are accurate and structurally faithful to the data. Existing explainability methods rely heavily on additive representations (e.g., Generalized Additive Models (GAMs), …
Interpretable Machine LearningRethinking Log Odds: Linear Probability Modelling and Expert Advice in Interpretable Machine Learning
We introduce a family of interpretable machine learning models, with two broad additions: Linearised Additive Models (LAMs) which replace the ubiquitous logistic link function in General Additive Models (GAMs); and Subsc…
Additive modelsBinary ClassificationInterpretable Machine LearningDeep-Learning Quantitative Structural Characterization in Additive Manufacturing
With a goal of accelerating fabrication of additively manufactured components with precise microstructures, we developed a method for structural characterization of key features in additively manufactured materials and p…
Deep LearningImage-to-Image TranslationTranslationScalable Interpretability via Polynomials
Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalabili…
Additive modelsBIG-bench Machine LearningInterpretable Machine Learning