paper-with-me

홈 › Papers

Multi-Label Out-of-Distribution Detection with Spectral Normalized Joint Energy

2024-05-08 · Yihan Mei, Xinyu Wang, Dell Zhang, Xiaoling Wang

In today's interconnected world, achieving reliable out-of-distribution (OOD) detection poses a significant challenge for machine learning models. While numerous studies have introduced improved approaches for multi-class OOD detection tasks, the investigation into multi-label OOD detection tasks has been notably limited. We introduce Spectral Normalized Joint Energy (SNoJoE), a method that consolidates label-specific information across multiple labels through the theoretically justified concept of an energy-based function. Throughout the training process, we employ spectral normalization to manage the model's feature space, thereby enhancing model efficacy and generalization, in addition to bolstering robustness. Our findings indicate that the application of spectral normalization to joint energy scores notably amplifies the model's capability for OOD detection. We perform OOD detection experiments utilizing PASCAL-VOC as the in-distribution dataset and ImageNet-22K or Texture as the out-of-distribution datasets. Our experimental results reveal that, in comparison to prior top performances, SNoJoE achieves 11% and 54% relative reductions in FPR95 on the respective OOD datasets, thereby defining the new state of the art in this field of study.

📄 PDF Abstract BibTeX arXiv:2405.04759

Code (1)

nicholas-mei/ood_detection_snojoe 공식 구현 pytorch

Tasks

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Spectral Normalization Spectral Normalization is a normalization technique used for generative adversarial networks, used to stabilize training of the discriminator. Spectral normalization has the…

Similar Papers 제목 키워드 기반

The geometry of kernelized spectral clustering

2014-04-29 · Geoffrey Schiebinger, Martin J. Wainwright, Bin Yu

Clustering of data sets is a standard problem in many areas of science and engineering. The method of spectral clustering is based on embedding the data set using a kernel function, and using the top eigenvectors of the …

Clustering

Uncertainty-Aware Image Classification In Biomedical Imaging Using Spectral-normalized Neural Gaussian Processes

2026-02-02 · Uma Meleti, Jeffrey J. Nirschl arxiv

Accurate histopathologic interpretation is key for clinical decision-making; however, current deep learning models for digital pathology are often overconfident and poorly calibrated in out-of-distribution (OOD) settings…

Image ClassificationGaussian Processes

A spectral method for community detection in moderately-sparse degree-corrected stochastic block models

2015-06-29 · Lennart Gulikers, Marc Lelarge, Laurent Massoulié

We consider community detection in Degree-Corrected Stochastic Block Models (DC-SBM). We propose a spectral clustering algorithm based on a suitably normalized adjacency matrix. We show that this algorithm consistently r…

ClusteringCommunity Detection

A Novel Approach for Dimensionality Reduction and Classification of Hyperspectral Images based on Normalized Synergy

2022-10-25 · Asma Elmaizi, Hasna Nhaila, Elkebir Sarhrouni, Ahmed Hammouch 외

During the last decade, hyperspectral images have attracted increasing interest from researchers worldwide. They provide more detailed information about an observed area and allow an accurate target detection and precise…

Classification Of Hyperspectral ImagesDimensionality Reduction

Spectrally-normalized margin bounds for neural networks

2017-06-26 · NeurIPS 2017 12 · Peter Bartlett, Dylan J. Foster, Matus Telgarsky

This paper presents a margin-based multiclass generalization bound for neural networks that scales with their margin-normalized "spectral complexity": their Lipschitz constant, meaning the product of the spectral norms o…