A tale of two toolkits, report the first: benchmarking time series classification algorithms for correctness and efficiency
sktime is an open source, Python based, sklearn compatible toolkit for time series analysis developed by researchers at the University of East Anglia (UEA), University College London and the Alan Turing Institute. A key initial goal for sktime was to provide time series classification functionality equivalent to that available in a related java package, tsml, also developed at UEA. We describe the implementation of six such classifiers in sktime and compare them to their tsml equivalents. We demonstrate correctness through equivalence of accuracy on a range of standard test problems and compare the build time of the different implementations. We find that there is significant difference in accuracy on only one of the six algorithms we look at (Proximity Forest). This difference is causing us some pain in debugging. We found a much wider range of difference in efficiency. Again, this was not unexpected, but it does highlight ways both toolkits could be improved.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingGeneral ClassificationTime SeriesTime Series AnalysisTime Series ClassificationSimilar Papers 제목 키워드 기반
A tale of two toolkits, report the third: on the usage and performance of HIVE-COTE v1.0
The Hierarchical Vote Collective of Transformation-based Ensembles (HIVE-COTE) is a heterogeneous meta ensemble for time series classification. Since it was first proposed in 2016, the algorithm has undergone some minor …
Time SeriesTime Series AnalysisTime Series ClassificationA tale of two toolkits, report the second: bake off redux. Chapter 1. dictionary based classifiers
Time series classification (TSC) is the problem of learning labels from time dependent data. One class of algorithms is derived from a bag of words approach. A window is run along a series, the subseries is shortened and…
ClassificationGeneral ClassificationTime SeriesTime Series Analysis+1MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experiments
Leaderboards are crucial in the machine learning (ML) domain for benchmarking and tracking progress. However, creating leaderboards traditionally demands significant manual effort. In recent years, efforts have been made…
Talent Hoarding in Organizations
Most organizations rely on managers to identify talented workers. However, managers who are evaluated on team performance have an incentive to hoard workers. This study provides the first empirical evidence of talent hoa…
State-of-the-Art Vietnamese Word Segmentation
Word segmentation is the first step of any tasks in Vietnamese language processing. This paper reviews stateof-the-art approaches and systems for word segmentation in Vietnamese. To have an overview of all stages from bu…
BIG-bench Machine LearningSegmentationVietnamese Word Segmentation