paper-with-me

홈 › Papers

Local Diagnostics of Continuous Normalizing Flow for Out-of-Distribution Detection

2026-05-30 · Xinwei Cao, Mengxuan Lu, Torbjørn Svendsen, Giampiero Salvi arxiv

We address the problem of out-of-distribution (OOD) detection for target observations embedded in a subspace of the high dimensional data space. Using continuous normalizing flows (CNFs), we propose a Lagrangian sub-flow (LSF) framework designed to isolate and estimate the density for the relevant components in the representation and using the remaining components as context. Through experimentation with models for speech synthesis, we show that CNFs, similarly to other deep generative models (DGMs), are susceptible to the "likelihood paradox", where high likelihood is erroneously assigned to OOD samples. This is attributed to the inductive bias of DGMs that prioritize low-level structural details over high-level semantic coherence. To mitigate this phenomenon, we propose a number of geometric diagnostic signals based on the velocity field over the sub-flow trajectory. Based on these signals, we design metrics for the challenging task of zero-shot phoneme-level mispronunciation detection. Finally, we demonstrate the superiority of these metrics compared to likelihood-based methods on a real-world mispronunciation detection benchmark.

📄 PDF Abstract BibTeX arXiv:2606.00684

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution DetectionSpeech Synthesis

Similar Papers 제목 키워드 기반

Validation Diagnostics for SBI algorithms based on Normalizing Flows

2022-11-17 · Julia Linhart, Alexandre Gramfort, Pedro L. C. Rodrigues

Building on the recent trend of new deep generative models known as Normalizing Flows (NF), simulation-based inference (SBI) algorithms can now efficiently accommodate arbitrary complex and high-dimensional data distribu…

A RAD approach to deep mixture models

2019-03-18 · ICLR Workshop DeepGenStruct 2019 · Laurent Dinh, Jascha Sohl-Dickstein, Hugo Larochelle, Razvan Pascanu

Flow based models such as Real NVP are an extremely powerful approach to density estimation. However, existing flow based models are restricted to transforming continuous densities over a continuous input space into simi…

Density Estimation

Argmax Flows: Learning Categorical Distributions with Normalizing Flows

2020-11-23 · pproximateinference AABI Symposium 2021 1 · Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré 외

This paper introduces a new method to define and train continuous distributions such as normalizing flows directly on categorical data, for example text and image segmentation. The generative model is defined by a compos…

Image SegmentationSemantic Segmentation

Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows

2024-05-23 · Alberto Cabezas, Louis Sharrock, Christopher Nemeth

Continuous normalizing flows (CNFs) learn the probability path between a reference distribution and a target distribution by modeling the vector field generating said path using neural networks. Recently, Lipman et al. (…

PINF: Continuous Normalizing Flows for Physics-Constrained Deep Learning

2023-09-26 · Feng Liu, Faguo Wu, Xiao Zhang

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensu…

Deep Learning