Improve Cost Efficiency of Active Learning over Noisy Dataset
Active learning is a learning strategy whereby the machine learning algorithm actively identifies and labels data points to optimize its learning. This strategy is particularly effective in domains where an abundance of unlabeled data exists, but the cost of labeling these data points is prohibitively expensive. In this paper, we consider cases of binary classification, where acquiring a positive instance incurs a significantly higher cost compared to that of negative instances. For example, in the financial industry, such as in money-lending businesses, a defaulted loan constitutes a positive event leading to substantial financial loss. To address this issue, we propose a shifted normal distribution sampling function that samples from a wider range than typical uncertainty sampling. Our simulation underscores that our proposed sampling function limits both noisy and positive label selection, delivering between 20% and 32% improved cost efficiency over different test datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningBinary ClassificationSimilar Papers 제목 키워드 기반
AutoWS: Automated Weak Supervision Framework for Text Classification
Creating large, good quality labeled data has become one of the major bottlenecks for developing machine learning applications. Multiple techniques have been developed to either decrease the dependence of labeled data (z…
Active LearningClassificationFew-Shot Learningtext-classification+1Active Label Cleaning for Reliable Detection of Electron Dense Deposits in Transmission Electron Microscopy Images
Automated detection of electron dense deposits (EDD) in glomerular disease is hindered by the scarcity of high-quality labeled data. While crowdsourcing reduces annotation cost, it introduces label noise. We propose an a…
Active LearningBoosting Active Learning for Speech Recognition with Noisy Pseudo-labeled Samples
The cost of annotating transcriptions for large speech corpora becomes a bottleneck to maximally enjoy the potential capacity of deep neural network-based automatic speech recognition models. In this paper, we present a …
Active LearningAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition+1Can LLMs Learn to Reason Robustly under Noisy Supervision?
Reinforcement Learning with Verifiable Rewards (RLVR) effectively trains reasoning models that rely on abundant perfect labels, but its vulnerability to unavoidable noisy labels due to expert scarcity remains critically …
Reinforcement LearningMathematical ReasoningRobust Deep Learning with Active Noise Cancellation for Spatial Computing
This paper proposes CANC, a Co-teaching Active Noise Cancellation method, applied in spatial computing to address deep learning trained with extreme noisy labels. Deep learning algorithms have been successful in spatial …
Deep LearningRetrieval