paper-with-me

홈 › Papers

Cardinality augmented loss functions

2026-01-08 · Miguel O'Malley arxiv

Class imbalance is a common and pernicious issue for the training of neural networks. Often, an imbalanced majority class can dominate training to skew classifier performance towards the majority outcome. To address this problem we introduce cardinality augmented loss functions, derived from cardinality-like invariants in modern mathematics literature such as magnitude and the spread. These invariants enrich the concept of cardinality by evaluating the `effective diversity' of a metric space, and as such represent a natural solution to overly homogeneous training data. In this work, we establish a methodology for applying cardinality augmented loss functions in the training of neural networks and report results on both artificially imbalanced datasets as well as a real-world imbalanced material science dataset. We observe significant performance improvement among minority classes, as well as improvement in overall performance metrics.

📄 PDF Abstract BibTeX arXiv:2601.04941

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cardinality-Aware Set Prediction and Top-$k$ Classification

2024-07-09 · Corinna Cortes, Anqi Mao, Christopher Mohri, Mehryar Mohri 외

We present a detailed study of cardinality-aware top-$k$ classification, a novel approach that aims to learn an accurate top-$k$ set predictor while maintaining a low cardinality. We introduce a new target loss function …

ClassificationPrediction

Top-$k$ Classification and Cardinality-Aware Prediction

2024-03-28 · Anqi Mao, Mehryar Mohri, Yutao Zhong

We present a detailed study of top-$k$ classification, the task of predicting the $k$ most probable classes for an input, extending beyond single-class prediction. We demonstrate that several prevalent surrogate loss fun…

ClassificationMulti-class ClassificationPrediction

Characterizing the Multiclass Learnability of Forgiving 0-1 Loss Functions

2025-10-09 · Jacob Trauger, Tyson Trauger, Ambuj Tewari arxiv

In this paper we will give a characterization of the learnability of forgiving 0-1 loss functions in the multiclass setting with effectively finite cardinality of the output and label space. To do this, we create a new c…

Properties of Minimizing Entropy

2021-12-06 · Xu Ji, Lena Nehale-Ezzine, Maksym Korablyov

Compact data representations are one approach for improving generalization of learned functions. We explicitly illustrate the relationship between entropy and cardinality, both measures of compactness, including how grad…

Holographic and other Point Set Distances for Machine Learning

2019-05-01 · ICLR 2019 5 · Lukas Balles, Thomas Fischbacher

We introduce an analytic distance function for moderately sized point sets of known cardinality that is shown to have very desirable properties, both as a loss function as well as a regularizer for machine learning appli…

BIG-bench Machine Learningobject-detectionObject Detection