paper-with-me

Papers

Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value

2025-10-02 · Wangxuan Fan, Ching Wang, Siqi Li, Nan Liu arxiv

For many real-world applications, understanding feature-outcome relationships is as crucial as achieving high predictive accuracy. While traditional neural networks excel at prediction, their black-box nature obscures underlying functional relationships. Kolmogorov--Arnold Networks (KANs) address this by employing learnable spline-based activation functions on edges, enabling recovery of symbolic representations while maintaining competitive performance. However, KAN's architecture presents unique challenges for network pruning. Conventional magnitude-based methods become unreliable due to sensitivity to input coordinate shifts. We propose \textbf{ShapKAN}, a pruning framework using Shapley value attribution to assess node importance in a shift-invariant manner. Unlike magnitude-based approaches, ShapKAN quantifies each node's actual contribution, ensuring consistent importance rankings regardless of input parameterization. Extensive experiments on synthetic and real-world datasets demonstrate that ShapKAN preserves true node importance while enabling effective network compression. Our approach improves KAN's interpretability advantages, facilitating deployment in resource-constrained environments.

📄 PDF Abstract BibTeX arXiv:2510.01663

Code (0)

등록된 구현이 없습니다.

Tasks

Network Pruning

Similar Papers 제목 키워드 기반

CIKAN: Constraint Informed Kolmogorov-Arnold Networks for Autonomous Spacecraft Rendezvous using Time Shift Governor

2024-12-04 · Taehyeun Kim, Anouck Girard, Ilya Kolmanovsky

The paper considers a Constrained-Informed Neural Network (CINN) approximation for the Time Shift Governor (TSG), which is an add-on scheme to the nominal closed-loop system used to enforce constraints by time-shifting t…

Kolmogorov-Arnold Networks

KAA: Kolmogorov-Arnold Attention for Enhancing Attentive Graph Neural Networks

2025-01-23 · Taoran Fang, Tianhong Gao, Chunping Wang, Yihao Shang 외

Graph neural networks (GNNs) with attention mechanisms, often referred to as attentive GNNs, have emerged as a prominent paradigm in advanced GNN models in recent years. However, our understanding of the critical process…

Kolmogorov-Arnold Network Autoencoders

2024-10-02 · Mohammadamin Moradi, Shirin Panahi, Erik Bollt, Ying-Cheng Lai

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov…

image-classificationImage ClassificationKolmogorov-Arnold Networks

Zero Shot Time Series Forecasting Using Kolmogorov Arnold Networks

2024-12-19 · Abhiroop Bhattacharya, Nandinee Haq

Accurate energy price forecasting is crucial for participants in day-ahead energy markets, as it significantly influences their decision-making processes. While machine learning-based approaches have shown promise in enh…

Domain AdaptationKolmogorov-Arnold NetworksTime SeriesTime Series Forecasting

KAT to KANs: A Review of Kolmogorov-Arnold Networks and the Neural Leap Forward

2024-11-15 · Divesh Basina, Joseph Raj Vishal, Aarya Choudhary, Bharatesh Chakravarthi

The curse of dimensionality poses a significant challenge to modern multilayer perceptron-based architectures, often causing performance stagnation and scalability issues. Addressing this limitation typically requires va…

Kolmogorov-Arnold Networks