LOSDD: Leave-Out Support Vector Data Description for Outlier Detection
Support Vector Machines have been successfully used for one-class classification (OCSVM, SVDD) when trained on clean data, but they work much worse on dirty data: outliers present in the training data tend to become support vectors, and are hence considered "normal". In this article, we improve the effectiveness to detect outliers in dirty training data with a leave-out strategy: by temporarily omitting one candidate at a time, this point can be judged using the remaining data only. We show that this is more effective at scoring the outlierness of points than using the slack term of existing SVM-based approaches. Identified outliers can then be removed from the data, such that outliers hidden by other outliers can be identified, to reduce the problem of masking. Naively, this approach would require training N individual SVMs (and training $O(N^2)$ SVMs when iteratively removing the worst outliers one at a time), which is prohibitively expensive. We will discuss that only support vectors need to be considered in each step and that by reusing SVM parameters and weights, this incremental retraining can be accelerated substantially. By removing candidates in batches, we can further improve the processing time, although it obviously remains more costly than training a single SVM.
Code (0)
등록된 구현이 없습니다.
Tasks
One-Class ClassificationOutlier DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Subspace Support Vector Data Description
This paper proposes a novel method for solving one-class classification problems. The proposed approach, namely Subspace Support Vector Data Description, maps the data to a subspace that is optimized for one-class classi…
ClassificationGeneral ClassificationOne-Class ClassificationSampling Method for Fast Training of Support Vector Data Description
Support Vector Data Description (SVDD) is a popular outlier detection technique which constructs a flexible description of the input data. SVDD computation time is high for large training datasets which limits its use in…
Outlier DetectionEllipsoidal Subspace Support Vector Data Description
In this paper, we propose a novel method for transforming data into a low-dimensional space optimized for one-class classification. The proposed method iteratively transforms data into a new subspace optimized for ellips…
General ClassificationOne-Class ClassificationInterleaved Text/Image Deep Mining on a Very Large-Scale Radiology Database
Despite tremendous progress in computer vision, effective learning on very large-scale (>100K patients) medical image databases has been vastly hindered. We present an interleaved text/image deep learning system to extra…
DiagnosticRetrievalSentenceGraph-Embedded Subspace Support Vector Data Description
In this paper, we propose a novel subspace learning framework for one-class classification. The proposed framework presents the problem in the form of graph embedding. It includes the previously proposed subspace one-cla…
General ClassificationGraph EmbeddingOne-Class Classification