paper-with-me

Papers

Deep Metric Learning with Spherical Embedding

2020-11-05 · NeurIPS 2020 12 · Dingyi Zhang, Yingming Li, Zhongfei Zhang

Deep metric learning has attracted much attention in recent years, due to seamlessly combining the distance metric learning and deep neural network. Many endeavors are devoted to design different pair-based angular loss functions, which decouple the magnitude and direction information for embedding vectors and ensure the training and testing measure consistency. However, these traditional angular losses cannot guarantee that all the sample embeddings are on the surface of the same hypersphere during the training stage, which would result in unstable gradient in batch optimization and may influence the quick convergence of the embedding learning. In this paper, we first investigate the effect of the embedding norm for deep metric learning with angular distance, and then propose a spherical embedding constraint (SEC) to regularize the distribution of the norms. SEC adaptively adjusts the embeddings to fall on the same hypersphere and performs more balanced direction update. Extensive experiments on deep metric learning, face recognition, and contrastive self-supervised learning show that the SEC-based angular space learning strategy significantly improves the performance of the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2011.02785

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionMetric LearningSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Cross-Domain 3D Equivariant Image Embeddings

2018-12-06 · Carlos Esteves, Avneesh Sud, Zhengyi Luo, Kostas Daniilidis 외

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications wh…

3D Shape ClassificationNovel View SynthesisObjectPose Estimation

Hyperspherical Query Likelihood Models with Word Embeddings

2017-11-01 · IJCNLP 2017 11 · Ryo Masumura, Taichi Asami, Hirokazu Masataki, Kugatsu Sadamitsu 외

This paper presents an initial study on hyperspherical query likelihood models (QLMs) for information retrieval (IR). Our motivation is to naturally utilize pre-trained word embeddings for probabilistic IR. To this end, …

Information RetrievalLanguage ModelingLanguage ModellingRetrieval+2

Geometry-Preserving Aggregation for Mixture-of-Experts Embedding Models

2026-02-15 · Sajjad Kachuee, Mohammad Sharifkhani arxiv

Mixture-of-Experts (MoE) embedding models combine expert outputs using weighted linear summation, implicitly assuming a linear subspace structure in the embedding space. This assumption is shown to be inconsistent with t…

Semantic Similarity

Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs

2022-09-19 · Roshni G. Iyer, Yunsheng Bai, Wei Wang, Yizhou Sun

Two-view knowledge graphs (KGs) jointly represent two components: an ontology view for abstract and commonsense concepts, and an instance view for specific entities that are instantiated from ontological concepts. As suc…

Knowledge GraphsVocal Bursts Valence Prediction

Linear Spherical Sliced Optimal Transport: A Fast Metric for Comparing Spherical Data

2024-11-09 · Xinran Liu, Yikun Bai, Rocío Díaz Martín, Kaiwen Shi 외

Efficient comparison of spherical probability distributions becomes important in fields such as computer vision, geosciences, and medicine. Sliced optimal transport distances, such as spherical and stereographic spherica…

3D Point Cloud InterpolationComputational Efficiency