paper-with-me

Papers

Wrapped Cauchy Distributed Angular Softmax for Long-Tailed Visual Recognition

2023-05-30 · Boran Han

Addressing imbalanced or long-tailed data is a major challenge in visual recognition tasks due to disparities between training and testing distributions and issues with data noise. We propose the Wrapped Cauchy Distributed Angular Softmax (WCDAS), a novel softmax function that incorporates data-wise Gaussian-based kernels into the angular correlation between feature representations and classifier weights, effectively mitigating noise and sparse sampling concerns. The class-wise distribution of angular representation becomes a sum of these kernels. Our theoretical analysis reveals that the wrapped Cauchy distribution excels the Gaussian distribution in approximating mixed distributions. Additionally, WCDAS uses trainable concentration parameters to dynamically adjust the compactness and margin of each class. Empirical results confirm label-aware behavior in these parameters and demonstrate WCDAS's superiority over other state-of-the-art softmax-based methods in handling long-tailed visual recognition across multiple benchmark datasets. The code is public available.

📄 PDF Abstract BibTeX arXiv:2305.18732

Code (1)

boranhan/wcdas_code 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Directional Statistics and Filtering Using libDirectional

2017-12-28 · Gerhard Kurz, Igor Gilitschenski, Florian Pfaff, Lukas Drude 외

In this paper, we present libDirectional, a MATLAB library for directional statistics and directional estimation. It supports a variety of commonly used distributions on the unit circle, such as the von Mises, wrapped no…

A Rotated Hyperbolic Wrapped Normal Distribution for Hierarchical Representation Learning

2022-05-25 · Seunghyuk Cho, Juyong Lee, Jaesik Park, Dongwoo Kim

We present a rotated hyperbolic wrapped normal distribution (RoWN), a simple yet effective alteration of a hyperbolic wrapped normal distribution (HWN). The HWN expands the domain of probabilistic modeling from Euclidean…

Representation Learning

Additive Margin Softmax for Face Verification

2018-01-17 · Feng Wang, Weiyang Liu, Haijun Liu, Jian Cheng

In this paper, we propose a conceptually simple and geometrically interpretable objective function, i.e. additive margin Softmax (AM-Softmax), for deep face verification. In general, the face verification task can be vie…

Face VerificationMetric Learning

Adaptive Margin Circle Loss for Speaker Verification

2021-06-15 · Runqiu Xiao

Deep-Neural-Network (DNN) based speaker verification sys-tems use the angular softmax loss with margin penalties toenhance the intra-class compactness of speaker embeddings,which achieved remarkable performance. In this …

Speaker Verification

X2-Softmax: Margin Adaptive Loss Function for Face Recognition

2023-12-08 · Jiamu Xu, Xiaoxiang Liu, Xinyuan Zhang, Yain-Whar Si 외

Learning the discriminative features of different faces is an important task in face recognition. By extracting face features in neural networks, it becomes easy to measure the similarity of different face images, which …

Face Recognition