Condensed Gradient Boosting
This paper presents a computationally efficient variant of gradient boosting for multi-class classification and multi-output regression tasks. Standard gradient boosting uses a 1-vs-all strategy for classifications tasks with more than two classes. This strategy translates in that one tree per class and iteration has to be trained. In this work, we propose the use of multi-output regressors as base models to handle the multi-class problem as a single task. In addition, the proposed modification allows the model to learn multi-output regression problems. An extensive comparison with other multi-ouptut based gradient boosting methods is carried out in terms of generalization and computational efficiency. The proposed method showed the best trade-off between generalization ability and training and predictions speeds.
Code (1)
Tasks
Computational EfficiencyMulti-class ClassificationregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pixel-wise classification in graphene-detection with tree-based machine learning algorithms
Mechanical exfoliation of graphene and its identification by optical inspection is one of the milestones in condensed matter physics that sparked the field of 2D materials. Finding regions of interest from the entire sam…
GPURobGC: Towards Robust Graph Condensation
Graph neural networks (GNNs) have attracted widespread attention for their impressive capability of graph representation learning. However, the increasing prevalence of large-scale graphs presents a significant challenge…
DenoisingGraph Representation LearningRepresentation LearningCondensed Stein Variational Gradient Descent for Uncertainty Quantification of Neural Networks
We propose a Stein variational gradient descent method to concurrently sparsify, train, and provide uncertainty quantification of a complexly parameterized model such as a neural network. It employs a graph reconciliatio…
SensitivityUncertainty QuantificationFederated Graph Condensation with Information Bottleneck Principles
Graph condensation (GC), which reduces the size of a large-scale graph by synthesizing a small-scale condensed graph as its substitution, has benefited various graph learning tasks. However, existing GC methods rely on c…
Graph LearningInference AttackMembership Inference AttackPrivacy PreservingTowards Model-Agnostic Dataset Condensation by Heterogeneous Models
Abstract. The advancement of deep learning has coincided with the proliferation of both models and available data. The surge in dataset sizes and the subsequent surge in computational requirements have led to the develop…
Dataset Condensation