paper-with-me

Papers

Tensor Polynomial Additive Model

2024-06-05 · Yang Chen, Ce Zhu, Jiani Liu, Yipeng Liu

Additive models can be used for interpretable machine learning for their clarity and simplicity. However, In the classical models for high-order data, the vectorization operation disrupts the data structure, which may lead to degenerated accuracy and increased computational complexity. To deal with these problems, we propose the tensor polynomial addition model (TPAM). It retains the multidimensional structure information of high-order inputs with tensor representation. The model parameter compression is achieved using a hierarchical and low-order symmetric tensor approximation. In this way, complex high-order feature interactions can be captured with fewer parameters. Moreover, The TPAM preserves the inherent interpretability of additive models, facilitating transparent decision-making and the extraction of meaningful feature values. Additionally, leveraging TPAM's transparency and ability to handle higher-order features, it is used as a post-processing module for other interpretation models by introducing two variants for class activation maps. Experimental results on a series of datasets demonstrate that TPAM can enhance accuracy by up to 30\%, and compression rate by up to 5 times, while maintaining a good interpretability.

📄 PDF Abstract BibTeX arXiv:2406.02980

Code (0)

등록된 구현이 없습니다.

Tasks

Additive modelsDecision MakingInterpretable Machine Learningmodel

Similar Papers 제목 키워드 기반

On the analysis of a higher-order Lotka-Volterra model: an application of S-tensors and the polynomial complementarity problem

2024-05-28 · Shaoxuan Cui, Qi Zhao, Guofeng Zhang, Hildeberto Jardón-Kojakhmetov 외

It is known that the effect of species' density on species' growth is non-additive in real ecological systems. This challenges the conventional Lotka-Volterra model, where the interactions are always pairwise and their e…

Tensor cumulants for statistical inference on invariant distributions

2024-04-29 · Dmitriy Kunisky, Cristopher Moore, Alexander S. Wein

Many problems in high-dimensional statistics appear to have a statistical-computational gap: a range of values of the signal-to-noise ratio where inference is information-theoretically possible, but (conjecturally) compu…

Tensor Networks

Near-Linear Time and Fixed-Parameter Tractable Algorithms for Tensor Decompositions

2022-07-15 · Arvind V. Mahankali, David P. Woodruff, Ziyu Zhang

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we…

Dimensionality ReductionTensor DecompositionTensor Networks

Scalable Interpretability via Polynomials

2022-05-27 · Abhimanyu Dubey, Filip Radenovic, Dhruv Mahajan

Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalabili…

Additive modelsBIG-bench Machine LearningInterpretable Machine Learning

Expressibility of neural quantum states: a Walsh-complexity perspective

2026-03-27 · Taige Wang arxiv

Neural quantum states are powerful variational wavefunctions, but it remains unclear which many-body states can be represented efficiently by modern additive architectures. We introduce Walsh complexity, a basis-dependen…