paper-with-me

홈 › Papers

The impact of imbalanced training data on machine learning for author name disambiguation

2018-07-30 · Jinseok Kim, Jenna Kim

In supervised machine learning for author name disambiguation, negative training data are often dominantly larger than positive training data. This paper examines how the ratios of negative to positive training data can affect the performance of machine learning algorithms to disambiguate author names in bibliographic records. On multiple labeled datasets, three classifiers - Logistic Regression, Na\"ive Bayes, and Random Forest - are trained through representative features such as coauthor names, and title words extracted from the same training data but with various positive-negative training data ratios. Results show that increasing negative training data can improve disambiguation performance but with a few percent of performance gains and sometimes degrade it. Logistic Regression and Na\"ive Bayes learn optimal disambiguation models even with a base ratio (1:1) of positive and negative training data. Also, the performance improvement by Random Forest tends to quickly saturate roughly after 1:10 ~ 1:15. These findings imply that contrary to the common practice using all training data, name disambiguation algorithms can be trained using part of negative training data without degrading much disambiguation performance while increasing computational efficiency. This study calls for more attention from author name disambiguation scholars to methods for machine learning from imbalanced data.

📄 PDF Abstract BibTeX arXiv:1808.00525

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningComputational Efficiencyregression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Twin Augmented Architectures for Robust Classification of COVID-19 Chest X-Ray Images

2021-02-16 · Kartikeya Badola, Sameer Ambekar, Himanshu Pant, Sumit Soman 외

The gold standard for COVID-19 is RT-PCR, testing facilities for which are limited and not always optimally distributed. Test results are delayed, which impacts treatment. Expert radiologists, one of whom is a co-author,…

COVID-19 DiagnosisGeneral ClassificationRobust classificationX-ray Classification

AdaBoost-CNN: An adaptive boosting algorithm for convolutional neural networks to classify multi-class imbalanced datasets using transfer learning

2020-09-03 · Neurocomputing 2020 9 · Aboozar Taherkhani, Georgina Cosma, T. M. McGinnity

Ensemble models achieve high accuracy by combining a number of base estimators and can increase the reliability of machine learning compared to a single estimator. Additionally, an ensemble model enables a machine learni…

BIG-bench Machine LearningTransfer Learning

Towards Understanding How Data Augmentation Works with Imbalanced Data

2023-04-12 · Damien A. Dablain, Nitesh V. Chawla

Data augmentation forms the cornerstone of many modern machine learning training pipelines; yet, the mechanisms by which it works are not clearly understood. Much of the research on data augmentation (DA) has focused on …

Data Augmentationfeature selection

Meta learning with language models: Challenges and opportunities in the classification of imbalanced text

2023-10-23 · Apostol Vassilev, Honglan Jin, Munawar Hasan

Detecting out of policy speech (OOPS) content is important but difficult. While machine learning is a powerful tool to tackle this challenging task, it is hard to break the performance ceiling due to factors like quantit…

Meta-Learning

Automated Imbalanced Learning

2022-11-01 · Prabhant Singh, Joaquin Vanschoren

Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real…

AutoML