paper-with-me

홈 › Papers

Unsupervised Mutual Learning of Dialogue Discourse Parsing and Topic Segmentation

2024-05-30 · Jiahui Xu, Feng Jiang, Anningzhe Gao, Haizhou Li

The advancement of large language models (LLMs) has propelled the development of dialogue systems. Unlike the popular ChatGPT-like assistant model, which only satisfies the user's preferences, task-oriented dialogue systems have also faced new requirements and challenges in the broader business field. They are expected to provide correct responses at each dialogue turn, at the same time, achieve the overall goal defined by the task. By understanding rhetorical structures and topic structures via topic segmentation and discourse parsing, a dialogue system may do a better planning to achieve both objectives. However, while both structures belong to discourse structure in linguistics, rhetorical structure and topic structure are mostly modeled separately or with one assisting the other in the prior work. The interaction between these two structures has not been considered for joint modeling and mutual learning. Furthermore, unsupervised learning techniques to achieve the above are not well explored. To fill this gap, we propose an unsupervised mutual learning framework of two structures leveraging the global and local connections between them. We extend the topic modeling between non-adjacent discourse units to ensure global structural relevance with rhetorical structures. We also incorporate rhetorical structures into the topic structure through a graph neural network model to ensure local coherence consistency. Finally, we utilize the similarity between the two fused structures for mutual learning. The experimental results demonstrate that our methods outperform all strong baselines on two dialogue rhetorical datasets (STAC and Molweni), as well as dialogue topic datasets (Doc2Dial and TIAGE). We provide our code at https://github.com/Jeff-Sue/URT.

📄 PDF Abstract BibTeX arXiv:2405.19799

Code (1)

jeff-sue/urt 공식 구현 pytorch

Tasks

Discourse ParsingGraph Neural NetworkTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study

2023-05-15 · Yaxin Fan, Feng Jiang, Peifeng Li, Haizhou Li

Large language models, like ChatGPT, have shown remarkable capability in many downstream tasks, yet their ability to understand discourse structures of dialogues remains less explored, where it requires higher level capa…

Discourse ParsingIn-Context LearningRelationSegmentation

An Unsupervised Dialogue Topic Segmentation Model Based on Utterance Rewriting

2024-09-12 · Xia Hou, QiFeng Li, Tongliang Li

Dialogue topic segmentation plays a crucial role in various types of dialogue modeling tasks. The state-of-the-art unsupervised DTS methods learn topic-aware discourse representations from conversation data through adjac…

Representation LearningSegmentationSemantic SimilaritySemantic Textual Similarity

Topic-Aware Multi-turn Dialogue Modeling

2020-09-26 · Yi Xu, Hai Zhao, Zhuosheng Zhang

In the retrieval-based multi-turn dialogue modeling, it remains a challenge to select the most appropriate response according to extracting salient features in context utterances. As a conversation goes on, topic shift a…

Retrieval

An Annotation Scheme of A Large-scale Multi-party Dialogues Dataset for Discourse Parsing and Machine Comprehension

2019-11-08 · Jiaqi Li, Ming Liu, Bing Qin, Zihao Zheng 외

In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension. The main goal of this project is to help understand multi-party dialogues. Our d…

Discourse ParsingMachine Reading ComprehensionReading Comprehension

Adapting Unsupervised Syntactic Parsing Methodology for Discourse Dependency Parsing

2021-08-01 · ACL 2021 5 · Liwen Zhang, Ge Wang, Wenjuan Han, Kewei Tu

One of the main bottlenecks in developing discourse dependency parsers is the lack of annotated training data. A potential solution is to utilize abundant unlabeled data by using unsupervised techniques, but there is so …

Dependency ParsingDiscourse Parsing