paper-with-me

Papers

beeFormer: Bridging the Gap Between Semantic and Interaction Similarity in Recommender Systems

2024-09-16 · Vojtěch Vančura, Pavel Kordík, Milan Straka

Recommender systems often use text-side information to improve their predictions, especially in cold-start or zero-shot recommendation scenarios, where traditional collaborative filtering approaches cannot be used. Many approaches to text-mining side information for recommender systems have been proposed over recent years, with sentence Transformers being the most prominent one. However, these models are trained to predict semantic similarity without utilizing interaction data with hidden patterns specific to recommender systems. In this paper, we propose beeFormer, a framework for training sentence Transformer models with interaction data. We demonstrate that our models trained with beeFormer can transfer knowledge between datasets while outperforming not only semantic similarity sentence Transformers but also traditional collaborative filtering methods. We also show that training on multiple datasets from different domains accumulates knowledge in a single model, unlocking the possibility of training universal, domain-agnostic sentence Transformer models to mine text representations for recommender systems. We release the source code, trained models, and additional details allowing replication of our experiments at https://github.com/recombee/beeformer.

📄 PDF Abstract BibTeX arXiv:2409.10309

Code (1)

recombee/beeformer 공식 구현 pytorch

Tasks

Collaborative FilteringRecommendation SystemsSemantic SimilaritySemantic Textual SimilaritySentence

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Enhanced Word Representations for Bridging Anaphora Resolution

2018-03-13 · NAACL 2018 6 · Yufang Hou

Most current models of word representations(e.g.,GloVe) have successfully captured fine-grained semantics. However, semantic similarity exhibited in these word embeddings is not suitable for resolving bridging anaphora, …

Bridging Anaphora ResolutionSemantic SimilaritySemantic Textual SimilarityWord Embeddings

Bridging the Gap Between Semantic and User Preference Spaces for Multi-modal Music Representation Learning

2025-05-29 · Xiaofeng Pan, Jing Chen, Haitong Zhang, Menglin Xing 외

Recent works of music representation learning mainly focus on learning acoustic music representations with unlabeled audios or further attempt to acquire multi-modal music representations with scarce annotated audio-text…

Collaborative FilteringContrastive LearningMusic RecommendationRepresentation Learning

Human Semantic Representations of Social Interactions from Moving Shapes

2025-09-25 · Yiling Yun, Hongjing Lu arxiv

Humans are social creatures who readily recognize various social interactions from simple display of moving shapes. While previous research has often focused on visual features, we examine what semantic representations t…

Exploiting Visual Semantic Reasoning for Video-Text Retrieval

2020-06-16 · Zerun Feng, Zhimin Zeng, Caili Guo, Zheng Li

Video retrieval is a challenging research topic bridging the vision and language areas and has attracted broad attention in recent years. Previous works have been devoted to representing videos by directly encoding from …

RetrievalText Retrievaltext similarityVideo Retrieval+1

Asymmetric Visual Semantic Embedding Framework for Efficient Vision-Language Alignment

2025-03-10 · Yang Liu, Mengyuan Liu, Shudong Huang, Jiancheng Lv

Learning visual semantic similarity is a critical challenge in bridging the gap between images and texts. However, there exist inherent variations between vision and language data, such as information density, i.e., imag…

Semantic SimilaritySemantic Textual Similarity