Adaptive Cost-sensitive Online Classification
Cost-Sensitive Online Classification has drawn extensive attention in recent years, where the main approach is to directly online optimize two well-known cost-sensitive metrics: (i) weighted sum of sensitivity and specificity; (ii) weighted misclassification cost. However, previous existing methods only considered first-order information of data stream. It is insufficient in practice, since many recent studies have proved that incorporating second-order information enhances the prediction performance of classification models. Thus, we propose a family of cost-sensitive online classification algorithms with adaptive regularization in this paper. We theoretically analyze the proposed algorithms and empirically validate their effectiveness and properties in extensive experiments. Then, for better trade off between the performance and efficiency, we further introduce the sketching technique into our algorithms, which significantly accelerates the computational speed with quite slight performance loss. Finally, we apply our algorithms to tackle several online anomaly detection tasks from real world. Promising results prove that the proposed algorithms are effective and efficient in solving cost-sensitive online classification problems in various real-world domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClassificationGeneral ClassificationSpecificityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Online classifier adaptation for cost-sensitive learning
In this paper, we propose the problem of online cost-sensitive clas- sifier adaptation and the first algorithm to solve it. We assume we have a base classifier for a cost-sensitive classification problem, but it is train…
ClassificationGeneral ClassificationAdaptive Cost-Sensitive Learning in Neural Networks for Misclassification Cost Problems
We design a new adaptive learning algorithm for misclassification cost problems that attempt to reduce the cost of misclassified instances derived from the consequences of various errors. Our algorithm (adaptive cost sen…
Binary ClassificationA Cost-Sensitive Deep Belief Network for Imbalanced Classification
Imbalanced data with a skewed class distribution are common in many real-world applications. Deep Belief Network (DBN) is a machine learning technique that is effective in classification tasks. However, conventional DBN …
ClassificationFault DiagnosisGeneral Classificationimbalanced classificationDynamic Principal Projection for Cost-Sensitive Online Multi-Label Classification
We study multi-label classification (MLC) with three important real-world issues: online updating, label space dimensional reduction (LSDR), and cost-sensitivity. Current MLC algorithms have not been designed to address …
ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Cost-Sensitive Convolution based Neural Networks for Imbalanced Time-Series Classification
Some deep convolutional neural networks were proposed for time-series classification and class imbalanced problems. However, those models performed degraded and even failed to recognize the minority class of an imbalance…
Deep LearningGeneral ClassificationTemporal SequencesTime Series+2