FeatGeNN: Improving Model Performance for Tabular Data with Correlation-based Feature Extraction
Automated Feature Engineering (AutoFE) has become an important task for any machine learning project, as it can help improve model performance and gain more information for statistical analysis. However, most current approaches for AutoFE rely on manual feature creation or use methods that can generate a large number of features, which can be computationally intensive and lead to overfitting. To address these challenges, we propose a novel convolutional method called FeatGeNN that extracts and creates new features using correlation as a pooling function. Unlike traditional pooling functions like max-pooling, correlation-based pooling considers the linear relationship between the features in the data matrix, making it more suitable for tabular data. We evaluate our method on various benchmark datasets and demonstrate that FeatGeNN outperforms existing AutoFE approaches regarding model performance. Our results suggest that correlation-based pooling can be a promising alternative to max-pooling for AutoFE in tabular data applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Feature EngineeringFeature EngineeringSimilar Papers 제목 키워드 기반
TabGSL: Graph Structure Learning for Tabular Data Prediction
This work presents a novel approach to tabular data prediction leveraging graph structure learning and graph neural networks. Despite the prevalence of tabular data in real-world applications, traditional deep learning m…
Contrastive LearningGraph Neural NetworkGraph structure learningPredictionTabular Data Contrastive Learning via Class-Conditioned and Feature-Correlation Based Augmentation
Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learn…
Contrastive LearningFeature CorrelationLocal Contrastive Feature learning for Tabular Data
Contrastive self-supervised learning has been successfully used in many domains, such as images, texts, graphs, etc., to learn features without requiring label information. In this paper, we propose a new local contrasti…
Self-Supervised LearningAutoDiff: combining Auto-encoder and Diffusion model for tabular data synthesizing
Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power …
Language ModelingLanguage ModellingSpeech SynthesisSynthetic Data GenerationFCT-GAN: Enhancing Table Synthesis via Fourier Transform
Synthetic tabular data emerges as an alternative for sharing knowledge while adhering to restrictive data access regulations, e.g., European General Data Protection Regulation (GDPR). Mainstream state-of-the-art tabular …
Generative Adversarial Network