paper-with-me

홈 › Papers

Adversarial Lagrangian Integrated Contrastive Embedding for Limited Size Datasets

2022-10-06 · Amin Jalali, Minho Lee

Certain datasets contain a limited number of samples with highly various styles and complex structures. This study presents a novel adversarial Lagrangian integrated contrastive embedding (ALICE) method for small-sized datasets. First, the accuracy improvement and training convergence of the proposed pre-trained adversarial transfer are shown on various subsets of datasets with few samples. Second, a novel adversarial integrated contrastive model using various augmentation techniques is investigated. The proposed structure considers the input samples with different appearances and generates a superior representation with adversarial transfer contrastive training. Finally, multi-objective augmented Lagrangian multipliers encourage the low-rank and sparsity of the presented adversarial contrastive embedding to adaptively estimate the coefficients of the regularizers automatically to the optimum weights. The sparsity constraint suppresses less representative elements in the feature space. The low-rank constraint eliminates trivial and redundant components and enables superior generalization. The performance of the proposed model is verified by conducting ablation studies by using benchmark datasets for scenarios with small data samples.

📄 PDF Abstract BibTeX arXiv:2210.03261

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LORE: Lagrangian-Optimized Robust Embeddings for Visual Encoders

2025-05-24 · Borna Khodabandeh, Amirabbas Afzali, Amirhossein Afsharrad, Seyed Shahabeddin Mousavi 외

Visual encoders have become fundamental components in modern computer vision pipelines. However, ensuring robustness against adversarial perturbations remains a critical challenge. Recent efforts have explored both super…

Adversarial RobustnessOut-of-Distribution Generalization

PDPGD: Primal-Dual Proximal Gradient Descent Adversarial Attack

2021-06-03 · Alexander Matyasko, Lap-Pui Chau

State-of-the-art deep neural networks are sensitive to small input perturbations. Since the discovery of this intriguing vulnerability, many defence methods have been proposed that attempt to improve robustness to advers…

Adversarial AttackAdversarial Robustness

Dual Adversarial Perturbators Generate rich Views for Recommendation

2024-08-26 · Lijun Zhang, Yuan YAO, Haibo Ye

Graph contrastive learning (GCL) has been extensively studied and leveraged as a potent tool in recommender systems. Most existing GCL-based recommenders generate contrastive views by altering the graph structure or intr…

Contrastive LearningGraph LearningRecommendation Systems

Robust Lagrangian and Adversarial Policy Gradient for Robust Constrained Markov Decision Processes

2023-08-22 · David M. Bossens

The robust constrained Markov decision process (RCMDP) is a recent task-modelling framework for reinforcement learning that incorporates behavioural constraints and that provides robustness to errors in the transition dy…

Incremental Learning

Adversarial Contrastive Estimation

2018-05-09 · ACL 2018 7 · Avishek Joey Bose, Huan Ling, Yanshuai Cao

Learning by contrasting positive and negative samples is a general strategy adopted by many methods. Noise contrastive estimation (NCE) for word embeddings and translating embeddings for knowledge graphs are examples in …

Contrastive LearningKnowledge Graph EmbeddingsKnowledge GraphsLearning Word Embeddings+1