Improving Sequential Query Recommendation with Immediate User Feedback
We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence learning approaches that exploit historical interaction data. Due to the supervision involved in the learning process, such approaches fail to adapt to immediate user feedback. We propose to augment the transformer-based causal language models for query recommendations to adapt to the immediate user feedback using multi-armed bandit (MAB) framework. We conduct a large-scale experimental study using log files from a popular online literature discovery service and demonstrate that our algorithm improves the per-round regret substantially, with respect to the state-of-the-art transformer-based query recommendation models, which do not make use of immediate user feedback. Our data model and source code are available at https://github.com/shampp/exp3_ss
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
High Quality Related Search Query Suggestions using Deep Reinforcement Learning
"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. …
Deep Reinforcement LearningDiversityreinforcement-learningReinforcement Learning+3Developing a Conversational Recommendation System for Navigating Limited Options
We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search term…
Conversational RecommendationNavigateChurn-Aware Recommendation Planning under Aggregated Preference Feedback
We study a sequential decision-making problem motivated by recent regulatory and technological shifts that limit access to individual user data in recommender systems (RSs), leaving only population-level preference infor…
CRAMER: Control via Request-Aware Masking for Editing Recommenders
Sequential recommendation models, while powerful, have limited flexibility in responding to immediate user requests, making it difficult to adapt their recommendations to the user's timely interests. Unfortunately, exist…
Sequential RecommendationPrompt EngineeringA Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing
Data plays a vital role in machine learning studies. In the research of recommendation, both user behaviors and side information are helpful to model users. So, large-scale real scenario datasets with abundant user behav…
Gender PredictionSequential Recommendation