Personalized word representations Carrying Personalized Semantics Learned from Social Network Posts
Distributed word representations have been shown to be very useful in various natural language processing (NLP) application tasks. These word vectors learned from huge corpora very often carry both semantic and syntactic information of words. However, it is well known that each individual user has his own language patterns because of different factors such as interested topics, friend groups, social activities, wording habits, etc., which may imply some kind of personalized semantics. With such personalized semantics, the same word may imply slightly differently for different users. For example, the word "Cappuccino" may imply "Leisure", "Joy", "Excellent" for a user enjoying coffee, by only a kind of drink for someone else. Such personalized semantics of course cannot be carried by the standard universal word vectors trained with huge corpora produced by many people. In this paper, we propose a framework to train different personalized word vectors for different users based on the very successful continuous skip-gram model using the social network data posted by many individual users. In this framework, universal background word vectors are first learned from the background corpora, and then adapted by the personalized corpus for each individual user to learn the personalized word vectors. We use two application tasks to evaluate the quality of the personalized word vectors obtained in this way, the user prediction task and the sentence completion task. These personalized word vectors were shown to carry some personalized semantics and offer improved performance on these two evaluation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence CompletionSimilar Papers 제목 키워드 기반
Exploring the Value of Personalized Word Embeddings
In this paper, we introduce personalized word embeddings, and examine their value for language modeling. We compare the performance of our proposed prediction model when using personalized versus generic word representat…
Authorship AttributionLanguage ModelingLanguage ModellingWord EmbeddingsCompositional Demographic Word Embeddings
Word embeddings are usually derived from corpora containing text from many individuals, thus leading to general purpose representations rather than individually personalized representations. While personalized embeddings…
Language ModelingLanguage ModellingWord EmbeddingsNRPA: Neural Recommendation with Personalized Attention
Existing review-based recommendation methods usually use the same model to learn the representations of all users/items from reviews posted by users towards items. However, different users have different preference and d…
InformativenessNews RecommendationRecommendation SystemsPersonalized Semantics Excitation for Federated Image Classification
Federated learning casts a light on the collaboration of distributed local clients with privacy protected to attain a more generic global model. However, significant distribution shift in input/label space across dif…
ClassificationFederated Learningimage-classificationImage Classification+2"This is my unicorn, Fluffy": Personalizing frozen vision-language representations
Large Vision & Language models pretrained on web-scale data provide representations that are invaluable for numerous V&L problems. However, it is unclear how they can be used for reasoning about user-specific visual conc…
Image RetrievalRetrievalSemantic SegmentationSentence+3