paper-with-me

홈 › Papers

Kolmogorov Arnold Networks (KANs) for Imbalanced Data -- An Empirical Perspective

2025-07-18 · Pankaj Yadav, Vivek Vijay arxiv

Kolmogorov Arnold Networks (KANs) are recent architectural advancement in neural computation that offer a mathematically grounded alternative to standard neural networks. This study presents an empirical evaluation of KANs in context of class imbalanced classification, using ten benchmark datasets. We observe that KANs can inherently perform well on raw imbalanced data more effectively than Multi-Layer Perceptrons (MLPs) without any resampling strategy. However, conventional imbalance strategies fundamentally conflict with KANs mathematical structure as resampling and focal loss implementations significantly degrade KANs performance, while marginally benefiting MLPs. Crucially, KANs suffer from prohibitive computational costs without proportional performance gains. Statistical validation confirms that MLPs with imbalance techniques achieve equivalence with KANs (|d| < 0.08 across metrics) at minimal resource costs. These findings reveal that KANs represent a specialized solution for raw imbalanced data where resources permit. But their severe performance-resource tradeoffs and incompatibility with standard resampling techniques currently limits practical deployment. We identify critical research priorities as developing KAN specific architectural modifications for imbalance learning, optimizing computational efficiency, and theoretical reconciling their conflict with data augmentation. This work establishes foundational insights for next generation KAN architectures in imbalanced classification scenarios.

📄 PDF Abstract BibTeX arXiv:2507.14121

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyData Augmentation

Similar Papers 제목 키워드 기반

KAN: Kolmogorov-Arnold Networks

2024-04-30 · Ziming Liu, YiXuan Wang, Sachin Vaidya, Fabian Ruehle 외

Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("ne…

Kolmogorov-Arnold Networks

Convolutional Kolmogorov-Arnold Networks

2024-06-19 · Alexander Dylan Bodner, Antonio Santiago Tepsich, Jack Natan Spolski, Santiago Pourteau

In this paper, we present Convolutional Kolmogorov-Arnold Networks, a novel architecture that integrates the learnable spline-based activation functions of Kolmogorov-Arnold Networks (KANs) into convolutional layers. By …

Kolmogorov-Arnold Networks

Empirical Stability Analysis of Kolmogorov-Arnold Networks in Hard-Constrained Recurrent Physics-Informed Discovery

2026-02-10 · Enzo Nicolas Spotorno, Josafat Leal Filho, Antonio Augusto Medeiros Frohlich arxiv

We investigate the integration of Kolmogorov-Arnold Networks (KANs) into hard-constrained recurrent physics-informed architectures (HRPINN) to evaluate the fidelity of learned residual manifolds in oscillatory systems. M…

DropKAN: Regularizing KANs by masking post-activations

2024-07-17 · Mohammed Ghaith Altarabichi

We propose DropKAN (Dropout Kolmogorov-Arnold Networks) a regularization method that prevents co-adaptation of activation function weights in Kolmogorov-Arnold Networks (KANs). DropKAN functions by embedding the drop mas…

Kolmogorov-Arnold Networks

Kolmogorov-Arnold Convolutions: Design Principles and Empirical Studies

2024-07-01 · Ivan Drokin

The emergence of Kolmogorov-Arnold Networks (KANs) has sparked significant interest and debate within the scientific community. This paper explores the application of KANs in the domain of computer vision (CV). We examin…

image-classificationImage ClassificationImage SegmentationKolmogorov-Arnold Networks