paper-with-me

Papers

Out-of-Distribution Detection of Melanoma using Normalizing Flows

2021-03-23 · M. M. A. Valiuddin, C. G. A. Viviers

Generative modelling has been a topic at the forefront of machine learning research for a substantial amount of time. With the recent success in the field of machine learning, especially in deep learning, there has been an increased interest in explainable and interpretable machine learning. The ability to model distributions and provide insight in the density estimation and exact data likelihood is an example of such a feature. Normalizing Flows (NFs), a relatively new research field of generative modelling, has received substantial attention since it is able to do exactly this at a relatively low cost whilst enabling competitive generative results. While the generative abilities of NFs are typically explored, we focus on exploring the data distribution modelling for Out-of-Distribution (OOD) detection. Using one of the state-of-the-art NF models, GLOW, we attempt to detect OOD examples in the ISIC dataset. We notice that this model under performs in conform related research. To improve the OOD detection, we explore the masking methods to inhibit co-adaptation of the coupling layers however find no substantial improvement. Furthermore, we utilize Wavelet Flow which uses wavelets that can filter particular frequency components, thus simplifying the modeling process to data-driven conditional wavelet coefficients instead of complete images. This enables us to efficiently model larger resolution images in the hopes that it would capture more relevant features for OOD. The paper that introduced Wavelet Flow mainly focuses on its ability of sampling high resolution images and did not treat OOD detection. We present the results and propose several ideas for improvement such as controlling frequency components, using different wavelets and using other state-of-the-art NF architectures.

📄 PDF Abstract BibTeX arXiv:2103.12672

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDensity EstimationInterpretable Machine LearningOut-of-Distribution DetectionOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Invertible 1x1 Convolution The Invertible 1x1 Convolution is a type of convolution used in flow-based generative models that reverses the ordering of…
Affine Coupling 설명 없음
Activation Normalization Activation Normalization is a type of normalization used for flow-based generative models; specifically it was introduced in the GLOW
GLOW 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Efficient Out-of-Distribution Detection of Melanoma with Wavelet-based Normalizing Flows

2022-08-09 · M. M. Amaan Valiuddin, Christiaan G. A. Viviers, Ruud J. G. van Sloun, Peter H. N. de With 외

Melanoma is a serious form of skin cancer with high mortality rate at later stages. Fortunately, when detected early, the prognosis of melanoma is promising and malignant melanoma incidence rates are relatively low. As a…

Density EstimationOut-of-Distribution DetectionOut of Distribution (OOD) DetectionPrognosis

Why Normalizing Flows Fail to Detect Out-of-Distribution Data

2020-06-15 · NeurIPS 2020 12 · Polina Kirichenko, Pavel Izmailov, Andrew Gordon Wilson

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distributi…

Out of Distribution (OOD) Detection

Feature Density Estimation for Out-of-Distribution Detection via Normalizing Flows

2024-02-09 · Evan D. Cook, Marc-Antoine Lavoie, Steven L. Waslander

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD d…

Density Estimationimage-classificationImage ClassificationOut-of-Distribution Detection+1

Out-of-distribution detection using normalizing flows on the data manifold

2023-08-26 · Seyedeh Fatemeh Razavi, Mohammad Mahdi Mehmanchi, Reshad Hosseini, Mostafa Tavassolipour

Using the intuition that out-of-distribution data have lower likelihoods, a common approach for out-of-distribution detection involves estimating the underlying data distribution. Normalizing flows are likelihood-based g…

Density EstimationOut-of-Distribution Detection

InFlow: Robust outlier detection utilizing Normalizing Flows

2021-06-10 · Nishant Kumar, Pia Hanfeld, Michael Hecht, Michael Bussmann 외

Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inp…

Density EstimationOutlier DetectionOut of Distribution (OOD) Detection