paper-with-me

Papers

Randomized Spline Trees for Functional Data Classification: Theory and Application to Environmental Time Series

2024-09-12 · Donato Riccio, Fabrizio Maturo, Elvira Romano

Functional data analysis (FDA) and ensemble learning can be powerful tools for analyzing complex environmental time series. Recent literature has highlighted the key role of diversity in enhancing accuracy and reducing variance in ensemble methods.This paper introduces Randomized Spline Trees (RST), a novel algorithm that bridges these two approaches by incorporating randomized functional representations into the Random Forest framework. RST generates diverse functional representations of input data using randomized B-spline parameters, creating an ensemble of decision trees trained on these varied representations. We provide a theoretical analysis of how this functional diversity contributes to reducing generalization error and present empirical evaluations on six environmental time series classification tasks from the UCR Time Series Archive. Results show that RST variants outperform standard Random Forests and Gradient Boosting on most datasets, improving classification accuracy by up to 14\%. The success of RST demonstrates the potential of adaptive functional representations in capturing complex temporal patterns in environmental data. This work contributes to the growing field of machine learning techniques focused on functional data and opens new avenues for research in environmental time series analysis.

📄 PDF Abstract BibTeX arXiv:2409.07879

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityEnsemble LearningTime SeriesTime Series AnalysisTime Series Classification

Similar Papers 제목 키워드 기반

How (Implicit) Regularization of ReLU Neural Networks Characterizes the Learned Function -- Part II: the Multi-D Case of Two Layers with Random First Layer

2023-03-20 · Jakob Heiss, Josef Teichmann, Hanna Wutte

Randomized neural networks (randomized NNs), where only the terminal layer's weights are optimized constitute a powerful model class to reduce computational time in training the neural network model. At the same time, th…

regression

On multivariate randomized classification trees: $l_0$-based sparsity, VC~dimension and decomposition methods

2021-12-09 · Edoardo Amaldi, Antonio Consolo, Andrea Manno

Decision trees are widely-used classification and regression models because of their interpretability and good accuracy. Classical methods such as CART are based on greedy approaches but a growing attention has recently …

Classificationfeature selection

Optimal randomized classification trees

2021-10-19 · Rafael Blanquero, Emilio Carrizosa, Cristina Molero-Río, Dolores Romero Morales

Classification and Regression Trees (CARTs) are off-the-shelf techniques in modern Statistics and Machine Learning. CARTs are traditionally built by means of a greedy procedure, sequentially deciding the splitting predic…

Classification

Online Learning With Bayesian Classification Trees

2016-06-01 · CVPR 2016 6 · Samuel Rota Bulo, Peter Kontschieder

Randomized classification trees are among the most popular machine learning tools and found successful applications in many areas. Although this classifier was originally designed as offline learning algorithm, there has…

BIG-bench Machine LearningClassificationGeneral Classification

ExSpliNet: An interpretable and expressive spline-based neural network

2022-05-03 · Daniele Fakhoury, Emanuele Fakhoury, Hendrik Speleers

In this paper we present ExSpliNet, an interpretable and expressive neural network model. The model combines ideas of Kolmogorov neural networks, ensembles of probabilistic trees, and multivariate B-spline representation…