paper-with-me

Papers

HKAN: Hierarchical Kolmogorov-Arnold Network without Backpropagation

2025-01-30 · Grzegorz Dudek, Tomasz Rodak

This paper introduces the Hierarchical Kolmogorov-Arnold Network (HKAN), a novel network architecture that offers a competitive alternative to the recently proposed Kolmogorov-Arnold Network (KAN). Unlike KAN, which relies on backpropagation, HKAN adopts a randomized learning approach, where the parameters of its basis functions are fixed, and linear aggregations are optimized using least-squares regression. HKAN utilizes a hierarchical multi-stacking framework, with each layer refining the predictions from the previous one by solving a series of linear regression problems. This non-iterative training method simplifies computation and eliminates sensitivity to local minima in the loss function. Empirical results show that HKAN delivers comparable, if not superior, accuracy and stability relative to KAN across various regression tasks, while also providing insights into variable importance. The proposed approach seamlessly integrates theoretical insights with practical applications, presenting a robust and efficient alternative for neural network modeling.

📄 PDF Abstract BibTeX arXiv:2501.18199

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

+ ( 1 ) ⟷ 805 ⟷ ( 330 ) ⟷ 4056|How do I file a complaint with Expedia? How do I file a complaint with Expedia contact customer service at + ( 1 ) ⟷ 888 ⟷ ( 829 ) ⟷ 0881 or + ( 1 ) ⟷ 805 ⟷ ( 330 ) ⟷ 4056, or use their Help Center. Explain your issue…
Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

GraphKAN: Enhancing Feature Extraction with Graph Kolmogorov Arnold Networks

2024-06-19 · Fan Zhang, Xin Zhang

Massive number of applications involve data with underlying relationships embedded in non-Euclidean space. Graph neural networks (GNNs) are utilized to extract features by capturing the dependencies within graphs. Despit…

Kolmogorov-Arnold Networks

Hierarchical RBF-KAN and RBF-SKAN Architectures for Multidimensional Function Approximation and Random Field Learning

2026-06-01 · Mingtao Xia, Qijing Shen arxiv

In this manuscript, we propose and analyze hierarchical Kolmogorov--Arnold neural network architectures employing radial basis functions as activation functions for approximating deterministic functions and random field …

KAN/H: Kolmogorov-Arnold Network using Haar-like bases

2025-11-13 · Susumu Katayama arxiv

Function approximation using Haar basis systems offers an efficient implementation when compressed via Patricia trees while retaining the flexibility of wavelets for both global and local fitting. However, like B-spline-…

KAT to KANs: A Review of Kolmogorov-Arnold Networks and the Neural Leap Forward

2024-11-15 · Divesh Basina, Joseph Raj Vishal, Aarya Choudhary, Bharatesh Chakravarthi

The curse of dimensionality poses a significant challenge to modern multilayer perceptron-based architectures, often causing performance stagnation and scalability issues. Addressing this limitation typically requires va…

Kolmogorov-Arnold Networks

asKAN: Active Subspace embedded Kolmogorov-Arnold Network

2025-04-07 · Zhiteng Zhou, Zhaoyue Xu, Yi Liu, Shizhao Wang

The Kolmogorov-Arnold Network (KAN) has emerged as a promising neural network architecture for small-scale AI+Science applications. However, it suffers from inflexibility in modeling ridge functions, which is widely used…