Identification of Novel Modes in Generative Models via Fourier-based Differential Clustering
An interpretable comparison of generative models requires the identification of sample types produced more frequently by each of the involved models. While several quantitative scores have been proposed in the literature to rank different generative models, such score-based evaluations do not reveal the nuanced differences between the generative models in capturing various sample types. In this work, we attempt to solve a differential clustering problem to detect sample types expressed differently by two generative models. To solve the differential clustering problem, we propose a method called Fourier-based Identification of Novel Clusters (FINC) to identify modes produced by a generative model with a higher frequency in comparison to a reference distribution. FINC provides a scalable stochastic algorithm based on random Fourier features to estimate the eigenspace of kernel covariance matrices of two generative models and utilize the principal eigendirections to detect the sample types present more dominantly in each model. We demonstrate the application of the FINC method to large-scale computer vision datasets and generative model frameworks. Our numerical results suggest the scalability of the developed Fourier-based method in highlighting the sample types produced with different frequencies by widely-used generative models. Code is available at \url{https://github.com/buyeah1109/FINC}
Code (1)
Tasks
ClusteringSimilar Papers 제목 키워드 기반
Unveiling Differences in Generative Models: A Scalable Differential Clustering Approach
A fine-grained comparison of generative models requires the identification of sample types generated differently by each of the involved models. While quantitative scores have been proposed in the literature to rank …
ClusteringFast and Efficient Estimation of Resonant Modes: A Case Study of Mechanical Drivelines
This work presents the development of an online parameter estimation algorithm for the identification of resonating modes in a linear system of arbitrary order. The method employs a short-time Fourier transform of the in…
parameter estimationIncremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs
Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-conve…
Clustering Categorical Data: Soft Rounding k-modes
Over the last three decades, researchers have intensively explored various clustering tools for categorical data analysis. Despite the proposal of various clustering algorithms, the classical k-modes algorithm remains a …
ClusteringEmpirical Fourier Decomposition: An Accurate Adaptive Signal Decomposition Method
Signal decomposition is an effective tool to assist the identification of modal information in time-domain signals. Two signal decomposition methods, including the empirical wavelet transform (EWT) and Fourier decomposit…
Computational Efficiency