paper-with-me

홈 › Papers

Dealing with Class Imbalance using Thresholding

2016-07-10 · Charmgil Hong, Rumi Ghosh, Soundar Srinivasan

We propose thresholding as an approach to deal with class imbalance. We define the concept of thresholding as a process of determining a decision boundary in the presence of a tunable parameter. The threshold is the maximum value of this tunable parameter where the conditions of a certain decision are satisfied. We show that thresholding is applicable not only for linear classifiers but also for non-linear classifiers. We show that this is the implicit assumption for many approaches to deal with class imbalance in linear classifiers. We then extend this paradigm beyond linear classification and show how non-linear classification can be dealt with under this umbrella framework of thresholding. The proposed method can be used for outlier detection in many real-life scenarios like in manufacturing. In advanced manufacturing units, where the manufacturing process has matured over time, the number of instances (or parts) of the product that need to be rejected (based on a strict regime of quality tests) becomes relatively rare and are defined as outliers. How to detect these rare parts or outliers beforehand? How to detect combination of conditions leading to these outliers? These are the questions motivating our research. This paper focuses on prediction of outliers and conditions leading to outliers using classification. We address the problem of outlier detection using classification. The classes are good parts (those passing the quality tests) and bad parts (those failing the quality tests and can be considered as outliers). The rarity of outliers transforms this problem into a class-imbalanced classification problem.

📄 PDF Abstract BibTeX arXiv:1607.02705

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classificationimbalanced classificationOutlier Detection

Similar Papers 제목 키워드 기반

OTLP: Output Thresholding Using Mixed Integer Linear Programming

2024-05-18 · Baran Koseoglu, Luca Traverso, Mohammed Topiwalla, Egor Kraev 외

Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in hig…

Fraud Detectionimbalanced classification

Fast estimation of Gaussian mixture components via centering and singular value thresholding

2026-04-21 · Huan Qing arxiv

Estimating the number of components is a fundamental challenge in unsupervised learning, particularly when dealing with high-dimensional data with many components or severely imbalanced component sizes. This paper addres…

DyConfidMatch: Dynamic Thresholding and Re-sampling for 3D Semi-supervised Learning

2024-11-13 · Zhimin Chen, Bing Li

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts. This study investigates class-level confidence as an indicat…

A systematic study of the class imbalance problem in convolutional neural networks

2017-10-15 · Mateusz Buda, Atsuto Maki, Maciej A. Mazurowski

In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance i…

BIG-bench Machine LearningGeneral Classification

New Hard-thresholding Rules based on Data Splitting in High-dimensional Imbalanced Classification

2021-11-05 · Arezou Mojiri, Abbas Khalili, Ali Zeinal Hamadani

In binary classification, imbalance refers to situations in which one class is heavily under-represented. This issue is due to either a data collection process or because one class is indeed rare in a population. Imbalan…

Binary Classificationimbalanced classification