paper-with-me

홈 › Papers

Improvising the Learning of Neural Networks on Hyperspherical Manifold

2021-09-29 · Lalith Bharadwaj Baru, Sai Vardhan Kanumolu, Akshay Patel Shilhora, Madhu G

The impact of convolution neural networks (CNNs) in the supervised settings provided tremendous increment in performance. The representations learned from CNN's operated on hyperspherical manifold led to insightful outcomes in face recognition, face identification, and other supervised tasks. A broad range of activation functions were developed with hypersphere intuition which performs superior to softmax in euclidean space. The main motive of this research is to provide insights. First, the stereographic projection is implied to transform data from Euclidean space ($\mathbb{R}^{n}$) to hyperspherical manifold ($\mathbb{S}^{n}$) to analyze the performance of angular margin losses. Secondly, proving theoretically and practically that decision boundaries constructed on hypersphere using stereographic projection obliges the learning of neural networks. Experiments have demonstrated that applying stereographic projection on existing state-of-the-art angular margin objective functions improved performance for standard image classification data sets (CIFAR-10,100). Further, we ran our experiments on malaria-thin blood smear images, resulting in effective outcomes. The code is publicly available at:https://github.com/barulalithb/stereo-angular-margin.

📄 PDF Abstract BibTeX arXiv:2109.14746

Code (1)

barulalithb/stereo-angular-margin 공식 구현 pytorch

Tasks

Face IdentificationFace Recognitionimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Harmonizing Geometry and Uncertainty: Diffusion with Hyperspheres

2025-06-12 · Muskan Dosi, Chiranjeev Chiranjeev, Kartik Thakral, Mayank Vatsa 외

Do contemporary diffusion models preserve the class geometry of hyperspherical data? Standard diffusion models rely on isotropic Gaussian noise in the forward process, inherently favoring Euclidean spaces. However, many …

Increasing Expressivity of a Hyperspherical VAE

2019-10-07 · Tim R. Davidson, Jakub M. Tomczak, Efstratios Gavves

Learning suitable latent representations for observed, high-dimensional data is an important research topic underlying many recent advances in machine learning. While traditionally the Gaussian normal distribution has be…

Mixed-curvature decision trees and random forests

2024-10-03 · Philippe Chlenski, Quentin Chu, Raiyan R. Khan, Kaizhu Du 외

Decision trees (DTs) and their random forest (RF) extensions are workhorses of classification and regression in Euclidean spaces. However, algorithms for learning in non-Euclidean spaces are still limited. We extend DT a…

Link Predictionregression

Geometry-Preserving Aggregation for Mixture-of-Experts Embedding Models

2026-02-15 · Sajjad Kachuee, Mohammad Sharifkhani arxiv

Mixture-of-Experts (MoE) embedding models combine expert outputs using weighted linear summation, implicitly assuming a linear subspace structure in the embedding space. This assumption is shown to be inconsistent with t…

Semantic Similarity

HoloByte: Continuous Hyperspherical Distillation for Tokenizer-Free Modeling

2026-03-10 · Vladimer Khasia arxiv

Sequence modeling universally relies on discrete subword tokenization to circumvent the $\mathcal{O}(N^2)$ computational intractability of native byte-level attention. However, this heuristic quantization imposes artific…