paper-with-me

홈 › Papers

Out-Of-Distribution Detection with Diversification (Provably)

2024-11-21 · Haiyun Yao, Zongbo Han, Huazhu Fu, Xi Peng, QinGhua Hu, Changqing Zhang

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training. However, we experimentally reveal that these methods still struggle to generalize their detection capabilities to unknown OOD data, due to the limited diversity of the auxiliary outliers collected. Therefore, we thoroughly examine this problem from the generalization perspective and demonstrate that a more diverse set of auxiliary outliers is essential for enhancing the detection capabilities. However, in practice, it is difficult and costly to collect sufficiently diverse auxiliary outlier data. Therefore, we propose a simple yet practical approach with a theoretical guarantee, termed Diversity-induced Mixup for OOD detection (diverseMix), which enhances the diversity of auxiliary outlier set for training in an efficient way. Extensive experiments show that diverseMix achieves superior performance on commonly used and recent challenging large-scale benchmarks, which further confirm the importance of the diversity of auxiliary outliers.

📄 PDF Abstract BibTeX arXiv:2411.14049

Code (1)

haiyunyao/diversemix 공식 구현 pytorch

Tasks

DiversityOut-of-Distribution DetectionOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음

Similar Papers 제목 키워드 기반

Scalable Ensemble Diversification for OOD Generalization and Detection

2024-09-25 · Alexander Rubinstein, Luca Scimeca, Damien Teney, Seong Joon Oh

Training a diverse ensemble of models has several practical applications such as providing candidates for model selection with better out-of-distribution (OOD) generalization, and enabling the detection of OOD samples vi…

Model Selection

Are benefits from oil - stocks diversification gone? New evidence from a dynamic copula and high frequency data

2015-02-10

Oil is perceived as a good diversification tool for stock markets. To fully understand this potential, we propose a new empirical methodology that combines generalized autoregressive score copula functions with high freq…

Empirical estimator of diversification quotient

2025-06-25 · Xia Han, Liyuan Lin, Mengshi Zhao

The Diversification Quotient (DQ), introduced by Han et al. (2025), is a recently proposed measure of portfolio diversification that quantifies the reduction in a portfolio's risk-level parameter attributable to diversif…

Decision MakingPortfolio Optimization

Unraveling the Key Components of OOD Generalization via Diversification

2023-12-26 · Harold Benoit, Liangze Jiang, Andrei Atanov, Oğuzhan Fatih Kar 외

Supervised learning datasets may contain multiple cues that explain the training set equally well, i.e., learning any of them would lead to the correct predictions on the training data. However, many of them can be spuri…

A Tale of Tail Covariances (and Diversified Tails)

2023-02-27 · Jan Rosenzweig

This paper deals with tail diversification in financial time series through the concept of statistical independence by way of differential entropy and mutual information. By using moments as contrast functions to isolate…

Time SeriesTime Series Analysis