Exploring the high dimensional geometry of HSI features
We explore feature space geometries induced by the 3-D Fourier scattering transform and deep neural network with extended attribute profiles on four standard hyperspectral images. We examine the distances and angles of class means, the variability of classes, and their low-dimensional structures. These statistics are compared to that of raw features, and our results provide insight into the vastly different properties of these two methods. We also explore a connection with the newly observed deep learning phenomenon of neural collapse.
Code (1)
Tasks
AttributeVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Exploring the Manifold of Neural Networks Using Diffusion Geometry
Drawing motivation from the manifold hypothesis, which posits that most high-dimensional data lies on or near low-dimensional manifolds, we apply manifold learning to the space of neural networks. We learn manifolds wher…
Dimensionality ReductionHyperparameter OptimizationNeural Architecture SearchExploring the Geometry and Topology of Neural Network Loss Landscapes
Recent work has established clear links between the generalization performance of trained neural networks and the geometry of their loss landscape near the local minima to which they converge. This suggests that qualitat…
Dimensionality ReductionThe Riemannian Geometry of Deep Generative Models
Deep generative models learn a mapping from a low dimensional latent space to a high-dimensional data space. Under certain regularity conditions, these models parameterize nonlinear manifolds in the data space. In this p…
TranslationHigh-Dimensional Bayesian Optimization via Nested Riemannian Manifolds
Despite the recent success of Bayesian optimization (BO) in a variety of applications where sample efficiency is imperative, its performance may be seriously compromised in settings characterized by high-dimensional para…
Bayesian OptimizationGaussian ProcessesVocal Bursts Intensity PredictionHigh-Dimensional Bayesian Optimization via Random Projection of Manifold Subspaces
Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common fr…
Bayesian OptimizationRepresentation Learning