How to boost autoencoders?
Autoencoders are a category of neural networks with applications in numerous domains and hence, improvement of their performance is gaining substantial interest from the machine learning community. Ensemble methods, such as boosting, are often adopted to enhance the performance of regular neural networks. In this work, we discuss the challenges associated with boosting autoencoders and propose a framework to overcome them. The proposed method ensures that the advantages of boosting are realized when either output (encoded or reconstructed) is used. The usefulness of the boosted ensemble is demonstrated in two applications that widely employ autoencoders: anomaly detection and clustering.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClusteringSimilar Papers 제목 키워드 기반
Unsupervised Boosting-based Autoencoder Ensembles for Outlier Detection
Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsu…
Dimensionality ReductionDiversityOutlier DetectionSupervised Autoencoders with Fractionally Differentiated Features and Triple Barrier Labelling Enhance Predictions on Noisy Data
This paper investigates the enhancement of financial time series forecasting with the use of neural networks through supervised autoencoders (SAE), to improve investment strategy performance. Using the Sharpe and Informa…
Time SeriesTime Series ForecastingEnsembling Sparse Autoencoders
Sparse autoencoders (SAEs) are used to decompose neural network activations into human-interpretable features. Typically, features learned by a single SAE are used for downstream applications. However, it has recently be…
DiversityLanguage ModelingLanguage ModellingRethinking Patch Dependence for Masked Autoencoders
In this work, we re-examine inter-patch dependencies in the decoding mechanism of masked autoencoders (MAE). We decompose this decoding mechanism for masked patch reconstruction in MAE into self-attention and cross-atten…
DecoderInstance SegmentationRepresentation LearningSemantic SegmentationImputing Knowledge Tracing Data with Subject-Based Training via LSTM Variational Autoencoders Frameworks
The issue of missing data poses a great challenge on boosting performance and application of deep learning models in the {\em Knowledge Tracing} (KT) problem. However, there has been the lack of understanding on the issu…
Knowledge Tracing