paper-with-me

홈 › Papers

Beyond Tree Models: A Hybrid Model of KAN and gMLP for Large-Scale Financial Tabular Data

2024-12-03 · Mingming Zhang, Jiahao Hu, Pengfei Shi, Ningtao Wang, Ruizhe Gao, Guandong Sun, Feng Zhao, Yulin kang, Xing Fu, Weiqiang Wang, Junbo Zhao

Tabular data plays a critical role in real-world financial scenarios. Traditionally, tree models have dominated in handling tabular data. However, financial datasets in the industry often encounter some challenges, such as data heterogeneity, the predominance of numerical features and the large scale of the data, which can range from tens of millions to hundreds of millions of records. These challenges can lead to significant memory and computational issues when using tree-based models. Consequently, there is a growing need for neural network-based solutions that can outperform these models. In this paper, we introduce TKGMLP, an hybrid network for tabular data that combines shallow Kolmogorov Arnold Networks with Gated Multilayer Perceptron. This model leverages the strengths of both architectures to improve performance and scalability. We validate TKGMLP on a real-world credit scoring dataset, where it achieves state-of-the-art results and outperforms current benchmarks. Furthermore, our findings demonstrate that the model continues to improve as the dataset size increases, making it highly scalable. Additionally, we propose a novel feature encoding method for numerical data, specifically designed to address the predominance of numerical features in financial datasets. The integration of this feature encoding method within TKGMLP significantly improves prediction accuracy. This research not only advances table prediction technology but also offers a practical and effective solution for handling large-scale numerical tabular data in various industrial applications.

📄 PDF Abstract BibTeX arXiv:2412.02097

Code (0)

등록된 구현이 없습니다.

Tasks

Kolmogorov-Arnold Networks

Similar Papers 제목 키워드 기반

KMLP: A Scalable Hybrid Architecture for Web-Scale Tabular Data Modeling

2026-02-26 · Mingming Zhang, Pengfei Shi, Zhiqing Xiao, Feng Zhao 외 arxiv

Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distribu…

Feature Engineering

Pay Attention to MLPs

2021-05-17 · NeurIPS 2021 12 · Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le

Transformers have become one of the most important architectural innovations in deep learning and have enabled many breakthroughs over the past few years. Here we propose a simple network architecture, gMLP, based on MLP…

Image ClassificationNatural Language InferenceQuestion AnsweringSentiment Analysis

Convolutional Gated MLP: Combining Convolutions & gMLP

2021-11-06 · A. Rajagopal, V. Nirmala

To the best of our knowledge, this is the first paper to introduce Convolutions to Gated MultiLayer Perceptron and contributes an implementation of this novel Deep Learning architecture. Google Brain introduced the gMLP …

Deep LearningTransfer Learning

Group-Connected Multilayer Perceptron Networks

2019-12-20 · Mohammad Kachuee, Sajad Darabi, Shayan Fazeli, Majid Sarrafzadeh

Despite the success of deep learning in domains such as image, voice, and graphs, there has been little progress in deep representation learning for domains without a known structure between features. For instance, a tab…

Representation Learning

GMLP: Building Scalable and Flexible Graph Neural Networks with Feature-Message Passing

2021-04-20 · Wentao Zhang, Yu Shen, Zheyu Lin, Yang Li 외

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-mess…