paper-with-me

Papers

Multi-Task End-to-End Training Improves Conversational Recommendation

2023-05-08 · Naveen Ram, Dima Kuzmin, Ellie Ka In Chio, Moustafa Farid Alzantot, Santiago Ontanon, Ambarish Jash, Judith Yue Li

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user's explicit preferences expressed in dialogue. While previous works in this area adopt complex multi-component approaches where the dialogue management and entity recommendation tasks are handled by separate components, we show that a unified transformer model, based on the T5 text-to-text transformer model, can perform competitively in both recommending relevant items and generating conversation dialogue. We fine-tune our model on the ReDIAL conversational movie recommendation dataset, and create additional training tasks derived from MovieLens (such as the prediction of movie attributes and related movies based on an input movie), in a multitask learning setting. Using a series of probe studies, we demonstrate that the learned knowledge in the additional tasks is transferred to the conversational setting, where each task leads to a 9%-52% increase in its related probe score.

📄 PDF Abstract BibTeX arXiv:2305.06218

Code (0)

등록된 구현이 없습니다.

Tasks

Conversational RecommendationDialogue ManagementManagementMovie Recommendation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Multi-Task End-to-End Training Improves Conversational Recommendation

2021-10-16 · ACL ARR October 2021 10 · Anonymous

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user’s explicit preferences expressed i…

Conversational RecommendationDialogue GenerationMovie Recommendation

Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation

2023-10-27 · Yeongseo Jung, Eunseo Jung, Lei Chen

In Conversational Recommendation System (CRS), an agent is asked to recommend a set of items to users within natural language conversations. To address the need for both conversational capability and personalized recomme…

Conversational RecommendationDiversityKnowledge DistillationMulti-Task Learning

On Estimating the Training Cost of Conversational Recommendation Systems

2020-11-10 · Stefanos Antaris, Dimitrios Rafailidis, Mohammad Aliannejadi

Conversational recommendation systems have recently gain a lot of attention, as users can continuously interact with the system over multiple conversational turns. However, conversational recommendation systems are based…

Conversational RecommendationKnowledge DistillationRecommendation Systems

Talk the Walk: Synthetic Data Generation for Conversational Music Recommendation

2023-01-27 · Megan Leszczynski, Shu Zhang, Ravi Ganti, Krisztian Balog 외

Recommender systems are ubiquitous yet often difficult for users to control, and adjust if recommendation quality is poor. This has motivated conversational recommender systems (CRSs), with control provided through natur…

Language ModellingMusic RecommendationRecommendation SystemsRetrieval+1

DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendation

2021-09-18 · EMNLP 2021 11 · Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu 외

In this paper, we provide a bilingual parallel human-to-human recommendation dialog dataset (DuRecDial 2.0) to enable researchers to explore a challenging task of multilingual and cross-lingual conversational recommendat…

Conversational Recommendation