paper-with-me

홈 › Papers

Learning from All Sides: Diversified Positive Augmentation via Self-distillation in Recommendation

2023-08-15 · Chong Liu, Xiaoyang Liu, Ruobing Xie, Lixin Zhang, Feng Xia, Leyu Lin

Personalized recommendation relies on user historical behaviors to provide user-interested items, and thus seriously struggles with the data sparsity issue. A powerful positive item augmentation is beneficial to address the sparsity issue, while few works could jointly consider both the accuracy and diversity of these augmented training labels. In this work, we propose a novel model-agnostic Diversified self-distillation guided positive augmentation (DivSPA) for accurate and diverse positive item augmentations. Specifically, DivSPA first conducts three types of retrieval strategies to collect high-quality and diverse positive item candidates according to users' overall interests, short-term intentions, and similar users. Next, a self-distillation module is conducted to double-check and rerank these candidates as the final positive augmentations. Extensive offline and online evaluations verify the effectiveness of our proposed DivSPA on both accuracy and diversity. DivSPA is simple and effective, which could be conveniently adapted to other base models and systems. Currently, DivSPA has been deployed on multiple widely-used real-world recommender systems.

📄 PDF Abstract BibTeX arXiv:2308.07629

Code (0)

등록된 구현이 없습니다.

Tasks

AllDiversityRecommendation SystemsRetrieval

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Improving Contrastive Learning by Visualizing Feature Transformation

2021-08-06 · ICCV 2021 10 · Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun 외

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of po…

Contrastive LearningData AugmentationPOSSelf-Supervised Learning

Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition

2024-04-28 · Yunbing Jia, Xiaoyu Kong, Fan Tang, Yixing Gao 외

In this paper, we reveal the two sides of data augmentation: enhancements in closed-set recognition correlate with a significant decrease in open-set recognition. Through empirical investigation, we find that multi-sampl…

Data AugmentationKnowledge DistillationOpen Set Learning

Understanding Diversity in Session-Based Recommendation

2022-08-29 · Qing Yin, Hui Fang, Zhu Sun, Yew-Soon Ong

Current session-based recommender systems (SBRSs) mainly focus on maximizing recommendation accuracy, while few studies have been devoted to improve diversity beyond accuracy. Meanwhile, it is unclear how the accuracy-or…

DiversityRecommendation SystemsSession-Based Recommendations

Domain-Agnostic Clustering with Self-Distillation

2021-11-23 · Mohammed Adnan, Yani A. Ioannou, Chuan-Yung Tsai, Graham W. Taylor

Recent advancements in self-supervised learning have reduced the gap between supervised and unsupervised representation learning. However, most self-supervised and deep clustering techniques rely heavily on data augmenta…

ClusteringData AugmentationDeep ClusteringKnowledge Distillation+2

Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation

2021-03-15 · CVPR 2021 1 · Mingi Ji, Seungjae Shin, Seunghyun Hwang, Gibeom Park 외

Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher network at the deployment stage. To reduce the…

Data AugmentationKnowledge Distillationobject-detectionObject Detection+3