A random forest system combination approach for error detection in digital dictionaries
When digitizing a print bilingual dictionary, whether via optical character recognition or manual entry, it is inevitable that errors are introduced into the electronic version that is created. We investigate automating the process of detecting errors in an XML representation of a digitized print dictionary using a hybrid approach that combines rule-based, feature-based, and language model-based methods. We investigate combining methods and show that using random forests is a promising approach. We find that in isolation, unsupervised methods rival the performance of supervised methods. Random forests typically require training data so we investigate how we can apply random forests to combine individual base methods that are themselves unsupervised without requiring large amounts of training data. Experiments reveal empirically that a relatively small amount of data is sufficient and can potentially be further reduced through specific selection criteria.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingOptical Character RecognitionOptical Character Recognition (OCR)Similar Papers 제목 키워드 기반
Enhancing Oceanic Variables Forecast in the Santos Channel by Estimating Model Error with Random Forests
In this work we improve forecasting of Sea Surface Height (SSH) and current velocity (speed and direction) in oceanic scenarios. We do so by resorting to Random Forests so as to predict the error of a numerical forecasti…
A New Random Forest Ensemble of Intuitionistic Fuzzy Decision Trees
Classification is essential to the applications in the field of data mining, artificial intelligence, and fault detection. There exists a strong need in developing accurate, suitable, and efficient classification methods…
ClassificationEnsemble LearningFault Detectionfeature selectionVectorized Adaptive Histograms for Sparse Oblique Forests
Classification using sparse oblique random forests provides guarantees on uncertainty and confidence while controlling for specific error types. However, they use more data and more compute than other tree ensembles beca…
Oriented Edge Forests for Boundary Detection
We present a simple, efficient model for learning boundary detection based on a random forest classifier. Our approach combines (1) efficient clustering of training examples based on simple partitioning of the space of l…
Boundary DetectionClusteringPowershell malware detection method based on features combination
In recent years, powershell is widely used in APT attack due to its ease of use and high concealment. Tradi- tional malicious code detection technology based on artificial feature extraction and machine learning method …
Malware Detection