paper-with-me

홈 › Papers

Constellation Loss: Improving the efficiency of deep metric learning loss functions for optimal embedding

2019-05-25 · Alfonso Medela, Artzai Picon

Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with the presence of many classes and scarcity on the number of images per class not only work to build classifiers, but to many other applications where measuring similarity is the key. Deep Neural Networks trained via metric learning also offer the possibility to solve few-shot learning problems. Currently used state of the art loss functions such as triplet and contrastive loss functions, still suffer from slow convergence due to the selection of effective training samples that has been partially solved by the multi-class N-pair loss by simultaneously adding additional samples from the different classes. In this work, we extend triplet and multiclass-N-pair loss function by proposing the constellation loss metric where the distances among all class combinations are simultaneously learned. We have compared our constellation loss for visual class embedding showing that our loss function over-performs the other methods by obtaining more compact clusters while achieving better classification results.

📄 PDF Abstract BibTeX arXiv:1905.10675

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningMetric LearningTriplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Joint Optimization of Geometric and Probabilistic Constellation Shaping for OFDM-ISAC Systems

2025-01-20 · Benedikt Geiger, Fan Liu, Shihang Lu, Andrej Rode 외

6G communications systems are expected to integrate radar-like sensing capabilities enabling novel use cases. However, integrated sensing and communications (ISAC) introduces a trade-off between communications and sensin…

ISAC

Interference-Aware Super-Constellation Design for NOMA

2025-03-10 · Mojtaba Vaezi, Xinliang Zhang

Non-orthogonal multiple access (NOMA) has gained significant attention as a potential next-generation multiple access technique. However, its implementation with finite-alphabet inputs faces challenges. Particularly, due…

AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks

2021-03-25 · CVPR 2022 1 · Hao Li, Tianwen Fu, Jifeng Dai, Hongsheng Li 외

Significant progress has been achieved in automating the design of various components in deep networks. However, the automatic design of loss functions for generic tasks with various evaluation metrics remains under-inve…

Global Minimizers of Sigmoid Contrastive Loss

2025-09-23 · Kiril Bangachev, Guy Bresler, Iliyas Noman, Yury Polyanskiy arxiv

The meta-task of obtaining and aligning representations through contrastive pretraining is steadily gaining importance since its introduction in CLIP and ALIGN. In this paper we theoretically explain the advantages of sy…

Transmitter Linearization by Beamforming

2011-09-01 · IEEE JOURNAL OF SOLID-STATE CIRCUITS, VOL. 46, NO. 9 2011 9 · ChuanKang Liang, Behzad Razavi

Millimeter-wave transmitters designed for dense signal constellations must deal with severe linearity-efficiency trade-offs. This paper proposes a method of blending beamforming and linearization that reduces the number …