paper-with-me

홈 › Papers

FOSSIL: Regret-minimizing weighting for robust learning under imbalance and small data

2025-09-16 · J. Cha, J. Lee, J. Cho, J. Shin arxiv

Imbalanced and small data regimes are pervasive in domains such as rare disease imaging, genomics, and disaster response, where labeled samples are scarce and naive augmentation often introduces artifacts. Existing solutions such as oversampling, focal loss, or meta-weighting address isolated aspects of this challenge but remain fragile or complex. We introduce FOSSIL (Flexible Optimization via Sample Sensitive Importance Learning), a unified weighting framework that seamlessly integrates class imbalance correction, difficulty-aware curricula, augmentation penalties, and warmup dynamics into a single interpretable formula. Unlike prior heuristics, the proposed framework provides regret-based theoretical guarantees and achieves consistent empirical gains over ERM, curriculum, and meta-weighting baselines on synthetic and real-world datasets, while requiring no architectural changes.

📄 PDF Abstract BibTeX arXiv:2509.13218

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FOSSIL: Regret-Minimizing Curriculum Learning for Metadata-Free and Low-Data Mpox Diagnosis

2025-10-11 · Sahng-Min Han, Minjae Kim, Jinho Cha, Se-woon Choe 외 arxiv

Deep learning in small and imbalanced biomedical datasets remains fundamentally constrained by unstable optimization and poor generalization. We present the first biomedical implementation of FOSSIL (Flexible Optimizatio…

Minimizing Weighted Counterfactual Regret with Optimistic Online Mirror Descent

2024-04-22 · Hang Xu, Kai Li, Bingyun Liu, Haobo Fu 외

Counterfactual regret minimization (CFR) is a family of algorithms for effectively solving imperfect-information games. It decomposes the total regret into counterfactual regrets, utilizing local regret minimization algo…

counterfactual

Learning to Re-weight Examples with Optimal Transport for Imbalanced Classification

2022-08-05 · Dandan Guo, Zhuo Li, Meixi Zheng, He Zhao 외

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different wei…

Bilevel Optimizationimbalanced classification

Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss

2019-06-18 · NeurIPS 2019 12 · Kaidi Cao, Colin Wei, Adrien Gaidon, Nikos Arechiga 외

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improv…

Long-tail LearningLong-tail learning with class descriptors

Balanced off-policy evaluation in general action spaces

2019-06-09 · Arjun Sondhi, David Arbour, Drew Dimmery

Estimation of importance sampling weights for off-policy evaluation of contextual bandits often results in imbalance - a mismatch between the desired and the actual distribution of state-action pairs after weighting. In …

Binary ClassificationcounterfactualMulti-Armed BanditsOff-policy evaluation