Improving Model Classification by Optimizing the Training Dataset
In the era of data-centric AI, the ability to curate high-quality training data is as crucial as model design. Coresets offer a principled approach to data reduction, enabling efficient learning on large datasets through importance sampling. However, conventional sensitivity-based coreset construction often falls short in optimizing for classification performance metrics, e.g., $F1$ score, focusing instead on loss approximation. In this work, we present a systematic framework for tuning the coreset generation process to enhance downstream classification quality. Our method introduces new tunable parameters--including deterministic sampling, class-wise allocation, and refinement via active sampling, beyond traditional sensitivity scores. Through extensive experiments on diverse datasets and classifiers, we demonstrate that tuned coresets can significantly outperform both vanilla coresets and full dataset training on key classification metrics, offering an effective path towards better and more efficient model training.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Optimizing Small Transformer-Based Language Models for Multi-Label Sentiment Analysis in Short Texts
Sentiment classification in short text datasets faces significant challenges such as class imbalance, limited training samples, and the inherent subjectivity of sentiment labels -- issues that are further intensified by …
Sentiment AnalysisData AugmentationFew-shot Classification via Adaptive Attention
Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-lear…
ClassificationFew-Shot LearningGeneral ClassificationMeta-LearningA Review of Machine Learning Classification Using Quantum Annealing for Real-world Applications
Optimizing the training of a machine learning pipeline helps in reducing training costs and improving model performance. One such optimizing strategy is quantum annealing, which is an emerging computing paradigm that has…
BIG-bench Machine LearningKeystoneML: Optimizing Pipelines for Large-Scale Advanced Analytics
Modern advanced analytics applications make use of machine learning techniques and contain multiple steps of domain-specific and general-purpose processing with high resource requirements. We present KeystoneML, a system…
BIG-bench Machine LearningGeneral Classificationimage-classificationImage ClassificationCRCEN: A Generalized Cost-sensitive Neural Network Approach for Imbalanced Classification
Classification on imbalanced datasets is a challenging task in real-world applications. Training conventional classification algorithms directly by minimizing classification error in this scenario can compromise model pe…
ClassificationGeneral Classificationimbalanced classification