paper-with-me

홈 › Papers

Learning a Formality-Aware Japanese Sentence Representation

2023-01-17 · Henry Li Xinyuan, Ray Lee, Jerry Chen, Kelly Marchisio

While the way intermediate representations are generated in encoder-decoder sequence-to-sequence models typically allow them to preserve the semantics of the input sentence, input features such as formality might be left out. On the other hand, downstream tasks such as translation would benefit from working with a sentence representation that preserves formality in addition to semantics, so as to generate sentences with the appropriate level of social formality -- the difference between speaking to a friend versus speaking with a supervisor. We propose a sequence-to-sequence method for learning a formality-aware representation for Japanese sentences, where sentence generation is conditioned on both the original representation of the input sentence, and a side constraint which guides the sentence representation towards preserving formality information. Additionally, we propose augmenting the sentence representation with a learned representation of formality which facilitates the extraction of formality in downstream tasks. We address the lack of formality-annotated parallel data by adapting previous works on procedural formality classification of Japanese sentences. Experimental results suggest that our techniques not only helps the decoder recover the formality of the input sentence, but also slightly improves the preservation of input sentence semantics.

📄 PDF Abstract BibTeX arXiv:2301.07209

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderSentence

Similar Papers 제목 키워드 기반

Controlling Japanese Honorifics in English-to-Japanese Neural Machine Translation

2019-11-01 · WS 2019 11 · Weston Feely, Eva Hasler, Adri{\`a} de Gispert

In the Japanese language different levels of honorific speech are used to convey respect, deference, humility, formality and social distance. In this paper, we present a method for controlling the level of formality of J…

Machine TranslationNMTSentenceTranslation

Illinois Japanese \leftrightarrow English News Translation for WMT 2021

2021-11-01 · WMT (EMNLP) 2021 11 · Giang Le, Shinka Mori, Lane Schwartz

This system paper describes an end-to-end NMT pipeline for the Japanese \leftrightarrow English news translation task as submitted to WMT 2021, where we explore the efficacy of techniques such as tokenizing with language…

NMTRerankingTranslation

Improving Machine Translation Formality Control with Weakly-Labelled Data Augmentation and Post Editing Strategies

2022-05-01 · IWSLT (ACL) 2022 5 · Daniel Zhang, Jiang Yu, Pragati Verma, Ashwinkumar Ganesan 외

This paper describes Amazon Alexa AI’s implementation for the IWSLT 2022 shared task on formality control. We focus on the unconstrained and supervised task for en→hi (Hindi) and en→ja (Japanese) pairs where very limited…

Data AugmentationMachine Translation

Inter-rater Agreement on Sentence Formality

2011-09-01 · Shibamouli Lahiri, Xiaofei Lu

Formality is one of the most important dimensions of writing style variation. In this study we conducted an inter-rater reliability experiment for assessing sentence formality on a five-point Likert scale, and obtained g…

Sentence

FAME-MT Dataset: Formality Awareness Made Easy for Machine Translation Purposes

2024-05-20 · Dawid Wiśniewski, Zofia Rostek, Artur Nowakowski

People use language for various purposes. Apart from sharing information, individuals may use it to express emotions or to show respect for another person. In this paper, we focus on the formality level of machine-genera…

Machine TranslationSentenceTranslation