Constellation Loss: Improving the efficiency of deep metric learning loss functions for optimal embedding
Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with the presence of many classes and scarcity on the number of images per class not only work to build classifiers, but to many other applications where measuring similarity is the key. Deep Neural Networks trained via metric learning also offer the possibility to solve few-shot learning problems. Currently used state of the art loss functions such as triplet and contrastive loss functions, still suffer from slow convergence due to the selection of effective training samples that has been partially solved by the multi-class N-pair loss by simultaneously adding additional samples from the different classes. In this work, we extend triplet and multiclass-N-pair loss function by proposing the constellation loss metric where the distances among all class combinations are simultaneously learned. We have compared our constellation loss for visual class embedding showing that our loss function over-performs the other methods by obtaining more compact clusters while achieving better classification results.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningMetric LearningTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Joint Optimization of Geometric and Probabilistic Constellation Shaping for OFDM-ISAC Systems
6G communications systems are expected to integrate radar-like sensing capabilities enabling novel use cases. However, integrated sensing and communications (ISAC) introduces a trade-off between communications and sensin…
ISACInterference-Aware Super-Constellation Design for NOMA
Non-orthogonal multiple access (NOMA) has gained significant attention as a potential next-generation multiple access technique. However, its implementation with finite-alphabet inputs faces challenges. Particularly, due…
AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks
Significant progress has been achieved in automating the design of various components in deep networks. However, the automatic design of loss functions for generic tasks with various evaluation metrics remains under-inve…
Global Minimizers of Sigmoid Contrastive Loss
The meta-task of obtaining and aligning representations through contrastive pretraining is steadily gaining importance since its introduction in CLIP and ALIGN. In this paper we theoretically explain the advantages of sy…
Transmitter Linearization by Beamforming
Millimeter-wave transmitters designed for dense signal constellations must deal with severe linearity-efficiency trade-offs. This paper proposes a method of blending beamforming and linearization that reduces the number …