Simple Modifications to Improve Tabular Neural Networks
There is growing interest in neural network architectures for tabular data. Many general-purpose tabular deep learning models have been introduced recently, with performance sometimes rivaling gradient boosted decision trees (GBDTs). These recent models draw inspiration from various sources, including GBDTs, factorization machines, and neural networks from other application domains. Previous tabular neural networks are also drawn upon, but are possibly under-considered, especially models associated with specific tabular problems. This paper focuses on several such models, and proposes modifications for improving their performance. When modified, these models are shown to be competitive with leading general-purpose tabular models, including GBDTs.
Code (1)
Similar Papers 제목 키워드 기반
Incorporating External Knowledge to Enhance Tabular Reasoning
Reasoning about tabular information presents unique challenges to modern NLP approaches which largely rely on pre-trained contextualized embeddings of text. In this paper, we study these challenges through the problem of…
Natural Language InferenceMore layers! End-to-end regression and uncertainty on tabular data with deep learning
This paper attempts to analyze the effectiveness of deep learning for tabular data processing. It is believed that decision trees and their ensembles is the leading method in this domain, and deep neural networks must be…
parameter estimationregressionWeather ForecastingModern Neighborhood Components Analysis: A Deep Tabular Baseline Two Decades Later
The growing success of deep learning in various domains has prompted investigations into its application to tabular data, where deep models have shown promising results compared to traditional tree-based methods. In this…
Missingness Bias Calibration in Feature Attribution Explanations
Popular explanation methods often produce unreliable feature importance scores due to missingness bias, a systematic distortion that arises when models are probed with ablated, out-of-distribution inputs. Existing soluti…
Feature ImportanceBinning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domains
The ability of deep networks to learn superior representations hinges on leveraging the proper inductive biases, considering the inherent properties of datasets. In tabular domains, it is critical to effectively handle h…
Inductive BiasRepresentation LearningSelf-Supervised Learning