paper-with-me

Papers

A Practice-Friendly LLM-Enhanced Paradigm with Preference Parsing for Sequential Recommendation

2024-06-01 · Dugang Liu, Shenxian Xian, Xiaolin Lin, Xiaolian Zhang, Hong Zhu, Yuan Fang, Zhen Chen, Zhong Ming

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the item side and instance-level supervised fine-tuning (SFT) to inject collaborative information into LLM, which is inefficient and limited in many applications. To alleviate these problems, this paper proposes a practice-friendly LLM-enhanced paradigm with preference parsing (P2Rec) for SRS. Specifically, in the information reconstruction stage, we design a new user-level SFT task for collaborative information injection with the assistance of a pre-trained SRS model, which is more efficient and compatible with limited text information. Our goal is to let LLM learn to reconstruct a corresponding prior preference distribution from each user's interaction sequence, where LLM needs to effectively parse the latent category of each item and the relationship between different items to accomplish this task. In the information augmentation stage, we feed each item into LLM to obtain a set of enhanced embeddings that combine collaborative information and LLM inference capabilities. These embeddings can then be used to help train various future SRS models. Finally, we verify the effectiveness and efficiency of our TSLRec on three SRS benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2406.00333

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
SFT Shrink and Fine-Tune, or SFT, is a type of distillation that avoids explicit distillation by copying parameters to a student student model and then fine-tuning.…
SRS Sticker Response Selector, or SRS, is a model for multi-turn dialog that automatically selects a sticker response. SRS first employs a convolutional based sticker image…

Similar Papers 제목 키워드 기반

Dependency Graph Parsing as Sequence Labeling

2024-10-23 · Ana Ezquerro, David Vilares, Carlos Gómez-Rodríguez

Various linearizations have been proposed to cast syntactic dependency parsing as sequence labeling. However, these approaches do not support more complex graph-based representations, such as semantic dependencies or enh…

Dependency Parsing

Statistical Priors for Implicit Preferences: Decoupling Skill Selection as a Local Harness in Personal Agents

2026-06-04 · Zeyu Gan, Huayi Tang, Yong Liu arxiv

As Large Language Model (LLM) capabilities advance, locally deployed personal agents relying on API-based remote models and external skills have emerged as a novel paradigm. With the rapid expansion of available skills, …

LinPP: a Python-friendly algorithm for Linear Pregroup Parsing

2021-06-01 · ACL (SemSpace, IWCS) 2021 6 · Irene Rizzo

We define a linear pregroup parser, by applying some key modifications to the minimal parser defined in (Preller, 2007). These include handling words as separate blocks, and thus respecting their syntactic role in the se…

Sentence

Self-Evolutionary Large Language Models through Uncertainty-Enhanced Preference Optimization

2024-09-17 · Jianing Wang, Yang Zhou, Xiaocheng Zhang, Mengjiao Bao 외

Iterative preference optimization has recently become one of the de-facto training paradigms for large language models (LLMs), but the performance is still underwhelming due to too much noisy preference data yielded in t…

Learning PyTorch Through A Neural Dependency Parsing Exercise

2021-06-01 · NAACL (TeachingNLP) 2021 6 · David Jurgens

Dependency parsing is increasingly the popular parsing formalism in practice. This assignment provides a practice exercise in implementing the shift-reduce dependency parser of Chen and Manning (2014). This parser is a t…

Dependency Parsing