paper-with-me

홈 › Papers

Enhancing User Behavior Sequence Modeling by Generative Tasks for Session Search

2022-08-23 · Haonan Chen, Zhicheng Dou, Yutao Zhu, Zhao Cao, Xiaohua Cheng, Ji-Rong Wen

Users' search tasks have become increasingly complicated, requiring multiple queries and interactions with the results. Recent studies have demonstrated that modeling the historical user behaviors in a session can help understand the current search intent. Existing context-aware ranking models primarily encode the current session sequence (from the first behavior to the current query) and compute the ranking score using the high-level representations. However, there is usually some noise in the current session sequence (useless behaviors for inferring the search intent) that may affect the quality of the encoded representations. To help the encoding of the current user behavior sequence, we propose to use a decoder and the information of future sequences and a supplemental query. Specifically, we design three generative tasks that can help the encoder to infer the actual search intent: (1) predicting future queries, (2) predicting future clicked documents, and (3) predicting a supplemental query. We jointly learn the ranking task with these generative tasks using an encoder-decoder structured approach. Extensive experiments on two public search logs demonstrate that our model outperforms all existing baselines, and the designed generative tasks can actually help the ranking task. Besides, additional experiments also show that our approach can be easily applied to various Transformer-based encoder-decoder models and improve their performance.

📄 PDF Abstract BibTeX arXiv:2208.10846

Code (1)

haon-chen/ase-official 공식 구현 pytorch

Tasks

DecoderDocument RankingSession Search

Similar Papers 제목 키워드 기반

PANTHER: Generative Pretraining Beyond Language for Sequential User Behavior Modeling

2025-10-11 · Guilin Li, Yun Zhang, Xiuyuan Chen, Chengqi Li 외 arxiv

Large language models (LLMs) have shown that generative pretraining can distill vast world knowledge into compact token representations. While LLMs encapsulate extensive world knowledge, they remain limited in modeling t…

Representation LearningFraud Detection

Modeling Behavioral Intensity and Transitions for Generative Recommendation

2026-04-27 · Wenxuan Yang, Xiaoyang Xu, Hanyu Zhang, Zhexuan Xu 외 arxiv

Multi-behavior recommendation aims to predict user conversions by modeling various interaction types that carry distinct intent signals. Recently, generative sequence modeling methods have emerged as an important paradig…

Multimodal Foundation Model-Driven User Interest Modeling and Behavior Analysis on Short Video Platforms

2025-09-05 · Yushang Zhao, Yike Peng, Li Zhang, Qianyi Sun 외 arxiv

With the rapid expansion of user bases on short video platforms, personalized recommendation systems are playing an increasingly critical role in enhancing user experience and optimizing content distribution. Traditional…

Recommendation Systems

GRAB: An LLM-Inspired Sequence-First Click-Through Rate Prediction Modeling Paradigm

2026-02-02 · Shaopeng Chen, Chuyue Xie, Huimin Ren, Shaozong Zhang 외 arxiv

Traditional Deep Learning Recommendation Models (DLRMs) face increasing bottlenecks in performance and efficiency, often struggling with generalization and long-sequence modeling. Inspired by the scaling success of Large…

Click-Through Rate Prediction

Large Memory Network for Recommendation

2025-02-08 · Hui Lu, Zheng Chai, Yuchao Zheng, Zhe Chen 외

Modeling user behavior sequences in recommender systems is essential for understanding user preferences over time, enabling personalized and accurate recommendations for improving user retention and enhancing business va…

Recommendation Systems