Cost-Sensitive Deep Learning with Layer-Wise Cost Estimation
While deep neural networks have succeeded in several visual applications, such as object recognition, detection, and localization, by reaching very high classification accuracies, it is important to note that many real-world applications demand varying costs for different types of misclassification errors, thus requiring cost-sensitive classification algorithms. Current models of deep neural networks for cost-sensitive classification are restricted to some specific network structures and limited depth. In this paper, we propose a novel framework that can be applied to deep neural networks with any structure to facilitate their learning of meaningful representations for cost-sensitive classification problems. Furthermore, the framework allows end-to-end training of deeper networks directly. The framework is designed by augmenting auxiliary neurons to the output of each hidden layer for layer-wise cost estimation, and including the total estimation loss within the optimization objective. Experimental results on public benchmark visual data sets with two cost information settings demonstrate that the proposed framework outperforms state-of-the-art cost-sensitive deep learning models.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDeep LearningGeneral ClassificationObject RecognitionSimilar Papers 제목 키워드 기반
Cost-Sensitive Hierarchical Classification through Layer-wise Abstentions
We study the problem of cost-sensitive hierarchical classification where a label taxonomy has a cost-sensitive loss associated with it, which represents the cost of (wrong) predictions at different levels of the hierarch…
ClassificationLocally Adaptive Learning Loss for Semantic Image Segmentation
We propose a novel locally adaptive learning estimator for enhancing the inter- and intra- discriminative capabilities of Deep Neural Networks, which can be used as improved loss layer for semantic image segmentation tas…
Image SegmentationSegmentationSemantic SegmentationPruning as a Cooperative Game: Surrogate-Assisted Layer Contribution Estimation for Large Language Models
While large language models (LLMs) demonstrate impressive performance across various tasks, their deployment in real-world scenarios is still constrained by high computational demands. Layer-wise pruning, a commonly empl…
Predictive Scheduling for Efficient Inference-Time Reasoning in Large Language Models
Large language models (LLMs) achieve state-of-the-art accuracy on complex reasoning tasks by generating multiple chain-of-thought (CoT) traces, but using a fixed token budget per query leads to over-computation on easy i…
QuickNets: Saving Training and Preventing Overconfidence in Early-Exit Neural Architectures
Deep neural networks have long training and processing times. Early exits added to neural networks allow the network to make early predictions using intermediate activations in the network in time-sensitive applications.…