NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation
Social norms fundamentally shape interpersonal communication. We present NormDial, a high-quality dyadic dialogue dataset with turn-by-turn annotations of social norm adherences and violations for Chinese and American cultures. Introducing the task of social norm observance detection, our dataset is synthetically generated in both Chinese and English using a human-in-the-loop pipeline by prompting large language models with a small collection of expert-annotated social norms. We show that our generated dialogues are of high quality through human evaluation and further evaluate the performance of existing large language models on this task. Our findings point towards new directions for understanding the nuances of social norms as they manifest in conversational contexts that span across languages and cultures.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling
Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, h…
Cross-Lingual TransferTransfer LearningThe University of Helsinki submissions to the IWSLT 2018 low-resource translation task
This paper presents the University of Helsinki submissions to the Basque–English low-resource translation task. Our primary system is a standard bilingual Transformer system, trained on the available parallel data and va…
TranslationModeling Bilingual Conversational Characteristics for Neural Chat Translation
Neural chat translation aims to translate bilingual conversational text, which has a broad application in international exchanges and cooperation. Despite the impressive performance of sentence-level and context-aware Ne…
Machine TranslationNMTSentenceTranslationBuilding Comparable Corpora for Assessing Multi-Word Term Alignment
Recent work has demonstrated the importance of dealing with Multi-Word Terms (MWTs) in several Natural Language Processing applications. In particular, MWTs pose serious challenges for alignment and machine translation s…
Machine TranslationBilingual Word Embeddings for Bilingual Terminology Extraction from Specialized Comparable Corpora
Bilingual lexicon extraction from comparable corpora is constrained by the small amount of available data when dealing with specialized domains. This aspect penalizes the performance of distributional-based approaches, w…
Word Embeddings