paper-with-me

Papers

Improving Sequential Query Recommendation with Immediate User Feedback

2022-05-12 · Shameem A Puthiya Parambath, Christos Anagnostopoulos, Roderick Murray-Smith

We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence learning approaches that exploit historical interaction data. Due to the supervision involved in the learning process, such approaches fail to adapt to immediate user feedback. We propose to augment the transformer-based causal language models for query recommendations to adapt to the immediate user feedback using multi-armed bandit (MAB) framework. We conduct a large-scale experimental study using log files from a popular online literature discovery service and demonstrate that our algorithm improves the per-round regret substantially, with respect to the state-of-the-art transformer-based query recommendation models, which do not make use of immediate user feedback. Our data model and source code are available at https://github.com/shampp/exp3_ss

📄 PDF Abstract BibTeX arXiv:2205.06297

Code (1)

shampp/exp3_ss 공식 구현

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

High Quality Related Search Query Suggestions using Deep Reinforcement Learning

2021-08-10 · Praveen Kumar Bodigutla

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. …

Deep Reinforcement LearningDiversityreinforcement-learningReinforcement Learning+3

Developing a Conversational Recommendation System for Navigating Limited Options

2021-04-13 · Victor S. Bursztyn, Jennifer Healey, Eunyee Koh, Nedim Lipka 외

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search term…

Conversational RecommendationNavigate

Churn-Aware Recommendation Planning under Aggregated Preference Feedback

2025-07-06 · Gur Keinan, Omer Ben-Porat arxiv

We study a sequential decision-making problem motivated by recent regulatory and technological shifts that limit access to individual user data in recommender systems (RSs), leaving only population-level preference infor…

CRAMER: Control via Request-Aware Masking for Editing Recommenders

2026-08-26 · Zhiyuan Julian Su, Naihe Feng, Zhen Luther Qin, Ga Wu arxiv

Sequential recommendation models, while powerful, have limited flexibility in responding to immediate user requests, making it difficult to adapt their recommendations to the user's timely interests. Unfortunately, exist…

Sequential RecommendationPrompt Engineering

A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing

2021-06-11 · Bin Hao, Min Zhang, Weizhi Ma, Shaoyun Shi 외

Data plays a vital role in machine learning studies. In the research of recommendation, both user behaviors and side information are helpful to model users. So, large-scale real scenario datasets with abundant user behav…

Gender PredictionSequential Recommendation