Reducing the Computational Complexity of Learning with Random Convolutional Features
In the last decade, there has been a surge of research interest in feature extraction using random sampling. These techniques are fast and scalable and, at the same time, have practical favorability in low-sample size and high-dimensional training data. Convolutional Kitchen Sinks-based methods are promising random feature extractors for time series data. Since these methods are data-independent, many of the extracted features are redundant. To address this problem, we propose a simple and efficient feature selection method based on knee/elbow detection in the curve of ordered coefficients in linear regression. Our empirical studies show that without significant loss in accuracy, the proposed feature selector, on average, prunes more than 84 percent of randomly generated features.
Code (1)
Tasks
feature selectionTime SeriesSimilar Papers 제목 키워드 기반
Generalization Properties of Learning with Random Features
We study the generalization properties of ridge regression with random features in the statistical learning framework. We show for the first time that $O(1/\sqrt{n})$ learning bounds can be achieved with only $O(\sqrt{n}…
regressionRandom forests with random projections of the output space for high dimensional multi-label classification
We adapt the idea of random projections applied to the output space, so as to enhance tree-based ensemble methods in the context of multi-label classification. We show how learning time complexity can be reduced without …
General ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONAn Efficient Labeled/Unlabeled Random Finite Set Algorithm for Multiobject Tracking
We propose an efficient random finite set (RFS) based algorithm for multiobject tracking in which the object states are modeled by a combination of a labeled multi-Bernoulli (LMB) RFS and a Poisson RFS. The less computat…
ObjectLow-complexity CNNs for Acoustic Scene Classification
This paper presents a low-complexity framework for acoustic scene classification (ASC). Most of the frameworks designed for ASC use convolutional neural networks (CNNs) due to their learning ability and improved performa…
Acoustic Scene ClassificationClassificationQuantizationScene ClassificationROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels
Most methods for time series classification that attain state-of-the-art accuracy have high computational complexity, requiring significant training time even for smaller datasets, and are intractable for larger datasets…
General ClassificationTime SeriesTime Series AnalysisTime Series Classification