paper-with-me

홈 › Papers

Decoupling Strategy and Surface Realization for Task-oriented Dialogues

2021-09-29 · Chenchen Ye, Lizi Liao, Fuli Feng, Wei Ji, Tat-Seng Chua

Task-oriented dialogue systems assist users in completing various tasks by generating appropriate responses. The key lies in effective strategy learning and surface realization, which are largely mixed together by the cutting-edge methods. They thus face two problems: a) the learning of high-level strategy could easily be misled by the detailed word sequence optimization, and b) directly emphasizing the agent's goal through reinforcement learning (RL) also leads to corrupted solutions like ungrammatical or repetitive responses. In this work, we propose to decouple the strategy learning and surface realization in a general framework, called DSSR. The core is to construct a latent content space for strategy optimization and disentangle the surface style from it. Specifically, we optimize the latent content distribution for strategy towards task completion, and assume that such distribution is shared across different surface style realizations. By further constructing an encoder-decoder scheme for the surface part, it not only facilitates decoupled optimization via RL for both strategy and surface asynchronously, but also supports controllable surface style transfer of responses. We test DSSR on the multi-domain dialogue datasets MultiWoz 2.0 and MultiWoz 2.1 in comparison with methods mixing strategy and surface realization in different levels, showing improvements in the performance evaluated by various evaluation metrics. Finally, we demonstrate the semantic meanings of latent content distributions to show the disentangling effect of DSSR, and show that it can do effective surface style transfer as by-products.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)Style TransferTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Towards a Surface Realization-Oriented Corpus Annotation

2012-05-01 · WS 2012 5 · Leo Wanner, Simon Mille, Bernd Bohnet
Text Generation

Surface Realization Using Pretrained Language Models

2020-12-01 · MSR (COLING) 2020 12 · Farhood Farahnak, Laya Rafiee, Leila Kosseim, Thomas Fevens

In the context of Natural Language Generation, surface realization is the task of generating the linear form of a text following a given grammar. Surface realization models usually consist of a cascade of complex sub-mod…

DecoderLanguage ModelingLanguage ModellingSentence+1

Select and Attend: Towards Controllable Content Selection in Text Generation

2019-09-10 · IJCNLP 2019 11 · Xiaoyu Shen, Jun Suzuki, Kentaro Inui, Hui Su 외

Many text generation tasks naturally contain two steps: content selection and surface realization. Current neural encoder-decoder models conflate both steps into a black-box architecture. As a result, the content to be d…

DecoderHeadline GenerationText Generation

AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction Benchmark

2021-09-15 · ACL 2022 5 · Niklas Friedrich, Kiril Gashteovski, Mingying Yu, Bhushan Kotnis 외

Open Information Extraction (OIE) is the task of extracting facts from sentences in the form of relations and their corresponding arguments in schema-free manner. Intrinsic performance of OIE systems is difficult to meas…

Open Information ExtractionSentence

Generating High-Quality Surface Realizations Using Data Augmentation and Factored Sequence Models

2018-05-20 · WS 2018 7 · Henry Elder, Chris Hokamp

This work presents a new state of the art in reconstruction of surface realizations from obfuscated text. We identify the lack of sufficient training data as the major obstacle to training high-performing models, and sol…

Data Augmentation