Embedding Semantic Hierarchy in Discrete Optimal Transport for Risk Minimization
The widely-used cross-entropy (CE) loss-based deep networks achieved significant progress w.r.t. the classification accuracy. However, the CE loss can essentially ignore the risk of misclassification which is usually measured by the distance between the prediction and label in a semantic hierarchical tree. In this paper, we propose to incorporate the risk-aware inter-class correlation in a discrete optimal transport (DOT) training framework by configuring its ground distance matrix. The ground distance matrix can be pre-defined following a priori of hierarchical semantic risk. Specifically, we define the tree induced error (TIE) on a hierarchical semantic tree and extend it to its increasing function from the optimization perspective. The semantic similarity in each level of a tree is integrated with the information gain. We achieve promising results on several large scale image classification tasks with a semantic tree structure in a plug and play manner.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationSemantic SimilaritySemantic Textual SimilaritySimilar Papers 제목 키워드 기반
Discrete Optimal Transport and Voice Conversion
In this work, we address the voice conversion (VC) task using a vector-based interface. To align audio embeddings between speakers, we employ discrete optimal transport mapping. Our evaluation results demonstrate the hig…
Audio GenerationVoice ConversionPISCES: Annotation-free Text-to-Video Post-Training via Optimal Transport-Aligned Rewards
Text-to-video (T2V) generation aims to synthesize videos with high visual quality and temporal consistency that are semantically aligned with input text. Reward-based post-training has emerged as a promising direction to…
Reinforcement LearningVideo GenerationOptimal Transport-Induced Samples against Out-of-Distribution Overconfidence
Deep neural networks (DNNs) often produce overconfident predictions on out-of-distribution (OOD) inputs, undermining their reliability in open-world environments. Singularities in semi-discrete optimal transport (OT) mar…
Discrete optimal transport is a strong audio adversarial attack
In this paper, we investigate discrete optimal transport (DOT) as a black-box attack against modern automatic speaker verification (ASV) and anti-spoofing countermeasure (CM) systems. Our attack operates as a post-proces…
Speaker VerificationAdversarial AttackOMH: Structured Sparsity via Optimally Matched Hierarchy for Unsupervised Semantic Segmentation
Unsupervised Semantic Segmentation (USS) involves segmenting images without relying on predefined labels, aiming to alleviate the burden of extensive human labeling. Existing methods utilize features generated by self-su…
ClusteringSemantic SegmentationUnsupervised Semantic Segmentation