paper-with-me

Papers

Node Classification in Random Trees

2023-11-20 · Wouter W. L. Nuijten, Vlado Menkovski

We propose a method for the classification of objects that are structured as random trees. Our aim is to model a distribution over the node label assignments in settings where the tree data structure is associated with node attributes (typically high dimensional embeddings). The tree topology is not predetermined and none of the label assignments are present during inference. Other methods that produce a distribution over node label assignment in trees (or more generally in graphs) either assume conditional independence of the label assignment, operate on a fixed graph topology, or require part of the node labels to be observed. Our method defines a Markov Network with the corresponding topology of the random tree and an associated Gibbs distribution. We parameterize the Gibbs distribution with a Graph Neural Network that operates on the random tree and the node embeddings. This allows us to estimate the likelihood of node assignments for a given random tree and use MCMC to sample from the distribution of node assignments. We evaluate our method on the tasks of node classification in trees on the Stanford Sentiment Treebank dataset. Our method outperforms the baselines on this dataset, demonstrating its effectiveness for modeling joint distributions of node labels in random trees.

📄 PDF Abstract BibTeX arXiv:2311.12167

Code (1)

wouterwln/neuralfactortrees 공식 구현 pytorch

Tasks

ClassificationGraph Neural NetworkNode Classification

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

On the Trade-off between the Number of Nodes and the Number of Trees in a Random Forest

2023-12-16 · Tatsuya Akutsu, Avraham A. Melkman, Atsuhiro Takasu

In this paper, we focus on the prediction phase of a random forest and study the problem of representing a bag of decision trees using a smaller bag of decision trees, where we only consider binary decision problems on t…

Fast Generation of Big Random Binary Trees

2020-01-13 · William B. Langdon

random_tree() is a linear time and space C++ implementation able to create trees of up to a billion nodes for genetic programming and genetic improvement experiments. A 3.60GHz CPU can generate more than 18 million rando…

CPU

Optimal randomized classification trees

2021-10-19 · Rafael Blanquero, Emilio Carrizosa, Cristina Molero-Río, Dolores Romero Morales

Classification and Regression Trees (CARTs) are off-the-shelf techniques in modern Statistics and Machine Learning. CARTs are traditionally built by means of a greedy procedure, sequentially deciding the splitting predic…

Classification

CO2 Forest: Improved Random Forest by Continuous Optimization of Oblique Splits

2015-06-19 · Mohammad Norouzi, Maxwell D. Collins, David J. Fleet, Pushmeet Kohli

We propose a novel algorithm for optimizing multivariate linear threshold functions as split functions of decision trees to create improved Random Forest classifiers. Standard tree induction methods resort to sampling an…

General ClassificationMulti-class Classification

Big Data Classification Using Augmented Decision Trees

2017-10-26 · Rajiv Sambasivan, Sourish Das

We present an algorithm for classification tasks on big data. Experiments conducted as part of this study indicate that the algorithm can be as accurate as ensemble methods such as random forests or gradient boosted tree…

ClassificationGeneral Classification