Uncharted Forest a Technique for Exploratory Data Analysis
Exploratory data analysis is crucial for developing and understanding classification models from high-dimensional datasets. We explore the utility of a new unsupervised tree ensemble called uncharted forest for visualizing class associations, sample-sample associations, class heterogeneity, and uninformative classes for provenance studies. The uncharted forest algorithm can be used to partition data using random selections of variables and metrics based on statistical spread. After each tree is grown, a tally of the samples that arrive at every terminal node is maintained. Those tallies are stored in single sample association matrix and a likelihood measure for each sample being partitioned with one another can be made. That matrix may be readily viewed as a heat map, and the probabilities can be quantified via new metrics that account for class or cluster membership. We display the advantages and limitations of using this technique by applying it to two classification datasets and three provenance study datasets. Two of the metrics presented in this paper are also compared with widely used metrics from two algorithms that have variance-based clustering mechanisms.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringGeneral ClassificationSimilar Papers 제목 키워드 기반
Classification based credit risk analysis: The case of Lending Club
In this paper, we performs a credit risk analysis, on the data of past loan applicants of a company named Lending Club. The calculation required the use of exploratory data analysis and machine learning classification al…
regressionTowards Automated Design of Bayesian Optimization via Exploratory Landscape Analysis
Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, wi…
AutoMLBayesian OptimizationHow much is my car worth? A methodology for predicting used cars prices using Random Forest
Cars are being sold more than ever. Developing countries adopt the lease culture instead of buying a new car due to affordability. Therefore, the rise of used cars sales is exponentially increasing. Car sellers sometimes…
Cultural Vocal Bursts Intensity PredictionIntrusion Detection: Machine Learning Baseline Calculations for Image Classification
Cyber security can be enhanced through application of machine learning by recasting network attack data into an image format, then applying supervised computer vision and other machine learning techniques to detect malic…
BIG-bench Machine LearningClassificationfeature selectionimage-classification+2A Survey of Machine Learning Algorithms for Detecting Ransomware Encryption Activity
A survey of machine learning techniques trained to detect ransomware is presented. This work builds upon the efforts of Taylor et al. in using sensor-based methods that utilize data collected from built-in instruments li…
BIG-bench Machine LearningCPU