paper-with-me

Papers

Convergent Boosted Smoothing for Modeling GraphData with Tabular Node Features

2021-09-29 · ICLR 2022 4 · Jiuhai Chen, Jonas Mueller, Vassilis N. Ioannidis, Soji Adeshina, Yangkun Wang, Tom Goldstein, David Wipf

Many practical modeling tasks require making predictions using tabular data composed of heterogeneous feature types (e.g., text-based, categorical, continuous, etc.). In this setting boosted decision trees and related ensembling techniques generally dominate real-world applications involving iid training/test sets. However, when there are relations between samples and the iid assumption is no longer reasonable, it remains unclear how to incorporate these dependencies within existing boosting pipelines. To this end, we propose a generalized framework for combining boosted trees and more general model ensembling techniques, with graph propagation layers that share node/sample information across edges connecting related samples. And unlike previous efforts to integrate graph-based models with boosting, our approach is anchored to a principled meta loss function such that provable convergence can be guaranteed under relatively mild assumptions. Across a variety of benchmarks involving non-iid graph data with tabular node features, our framework achieves comparable or superior performance.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Does your graph need a confidence boost? Convergent boosted smoothing on graphs with tabular node features

2021-10-26 · Jiuhai Chen, Jonas Mueller, Vassilis N. Ioannidis, Soji Adeshina 외

For supervised learning with tabular data, decision tree ensembles produced via boosting techniques generally dominate real-world applications involving iid training/test sets. However for graph data where the iid assump…

Graph Neural Network

Unmasking Trees for Tabular Data

2024-07-08 · Calvin Mccarter

Despite much work on advanced deep learning and generative modeling techniques for tabular data generation and imputation, traditional methods have continued to win on imputation benchmarks. We herein present UnmaskingTr…

Density EstimationImputationIn-Context LearningTabular Data Generation

BUFF: Boosted Decision Tree based Ultra-Fast Flow matching

2024-04-28 · Cheng Jiang, Sitian Qian, Huilin Qu

Tabular data stands out as one of the most frequently encountered types in high energy physics. Unlike commonly homogeneous data such as pixelated images, simulating high-dimensional tabular data and accurately capturing…

TabKANet: Tabular Data Modeling with Kolmogorov-Arnold Network and Transformer

2024-09-13 · Weihao Gao, Zheng Gong, Zhuo Deng, Fuju Rong 외

Tabular data is the most common type of data in real-life scenarios. In this study, we propose the TabKANet model for tabular data modeling, which targets the bottlenecks in learning from numerical content. We constructe…

Binary ClassificationMulti-class Classification

XBNet : An Extremely Boosted Neural Network

2021-06-09 · Tushar Sarkar

Neural networks have proved to be very robust at processing unstructured data like images, text, videos, and audio. However, it has been observed that their performance is not up to the mark in tabular data; hence tree-b…

Anomaly DetectionBreast Cancer DetectionDiabetes PredictionFraud Detection+3