paper-with-me

Papers

ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarization

2022-02-11 · Jiaan Wang, Fandong Meng, Ziyao Lu, Duo Zheng, Zhixu Li, Jianfeng Qu, Jie zhou

We present ClidSum, a benchmark dataset for building cross-lingual summarization systems on dialogue documents. It consists of 67k+ dialogue documents from two subsets (i.e., SAMSum and MediaSum) and 112k+ annotated summaries in different target languages. Based on the proposed ClidSum, we introduce two benchmark settings for supervised and semi-supervised scenarios, respectively. We then build various baseline systems in different paradigms (pipeline and end-to-end) and conduct extensive experiments on ClidSum to provide deeper analyses. Furthermore, we propose mDialBART which extends mBART-50 (a multi-lingual BART) via further pre-training. The multiple objectives used in the further pre-training stage help the pre-trained model capture the structural characteristics as well as important content in dialogues and the transformation from source to the target language. Experimental results show the superiority of mDialBART, as an end-to-end model, outperforms strong pipeline models on ClidSum. Finally, we discuss specific challenges that current approaches faced with this task and give multiple promising directions for future research. We have released the dataset and code at https://github.com/krystalan/ClidSum.

📄 PDF Abstract BibTeX arXiv:2202.05599

Code (2)

krystalan/clidsum 공식 구현 pytorch
xcfcode/msamsum

Similar Papers 제목 키워드 기반

BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling

2021-06-05 · Zhaojiang Lin, Andrea Madotto, Genta Indra Winata, Peng Xu 외

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, h…

Cross-Lingual TransferTransfer Learning

Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation

2022-01-31 · Olga Majewska, Evgeniia Razumovskaia, Edoardo Maria Ponti, Ivan Vulić 외

Multilingual task-oriented dialogue (ToD) facilitates access to services and information for many (communities of) speakers. Nevertheless, the potential of this technology is not fully realised, as current datasets for m…

Dialogue State TrackingEnd-To-End Dialogue ModellingNatural Language UnderstandingSpecificity+1

MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages

2022-08-27 · Qingyu Zhang, Xiaoyu Shen, Ernie Chang, Jidong Ge 외

Owing to the lack of corpora for low-resource languages, current works on dialogue generation have mainly focused on English. In this paper, we present mDIA, the first large-scale multilingual benchmark for dialogue gene…

ChatbotDialogue GenerationDiversity

Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking

2026-05-28 · Songbo Hu, Yinhong Liu, Ej Zhou, Evgeniia Razumovskaia 외 arxiv

Creating spoken dialogue datasets is methodologically challenging, and these challenges are amplified when the goal is to build multilingual, multi-parallel datasets at scale. This work introduces HEALTHDIAL, a large-sca…

An Empirical Study of Cross-Lingual Transferability in Generative Dialogue State Tracker

2021-01-27 · Yen-Ting Lin, Yun-Nung Chen

There has been a rapid development in data-driven task-oriented dialogue systems with the benefit of large-scale datasets. However, the progress of dialogue systems in low-resource languages lags far behind due to the la…

dialog state trackingDialogue State TrackingTask-Oriented Dialogue Systems