Translate and Label! An Encoder-Decoder Approach for Cross-lingual Semantic Role Labeling
We propose a Cross-lingual Encoder-Decoder model that simultaneously translates and generates sentences with Semantic Role Labeling annotations in a resource-poor target language. Unlike annotation projection techniques, our model does not need parallel data during inference time. Our approach can be applied in monolingual, multilingual and cross-lingual settings and is able to produce dependency-based and span-based SRL annotations. We benchmark the labeling performance of our model in different monolingual and multilingual settings using well-known SRL datasets. We then train our model in a cross-lingual setting to generate new SRL labeled data. Finally, we measure the effectiveness of our method by using the generated data to augment the training basis for resource-poor languages and perform manual evaluation to show that it produces high-quality sentences and assigns accurate semantic role annotations. Our proposed architecture offers a flexible method for leveraging SRL data in multiple languages.
Code (1)
Tasks
DecoderSemantic Role LabelingSimilar Papers 제목 키워드 기반
TransAlign: Machine Translation Encoders are Strong Word Aligners, Too
In the absence of sizable training data for most world languages and NLP tasks, translation-based strategies such as translate-test -- evaluating on noisy source language data translated from the target language -- and t…
Cross-Lingual TransferMachine TranslationMultilingual Unsupervised NMT using Shared Encoder and Language-Specific Decoders
In this paper, we propose a multilingual unsupervised NMT scheme which jointly trains multiple languages with a shared encoder and multiple decoders. Our approach is based on denoising autoencoding of each language and b…
DenoisingNMTTranslationXSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representations
Cross-Lingual Semantic Parsing (CLSP) aims to translate queries in multiple natural languages (NLs) into meaning representations (MRs) such as SQL, lambda calculus, and logic forms. However, existing CLSP models are sepa…
Cross-Lingual TransferDecoderSemantic ParsingTransfer Learning+1Exploring Pretraining via Active Forgetting for Improving Cross Lingual Transfer for Decoder Language Models
Large Language Models (LLMs) demonstrate exceptional capabilities in a multitude of NLP tasks. However, the efficacy of such models to languages other than English is often limited. Prior works have shown that encoder-on…
Cross-Lingual TransferDecoderClueGraphSum: Let Key Clues Guide the Cross-Lingual Abstractive Summarization
Cross-Lingual Summarization (CLS) is the task to generate a summary in one language for an article in a different language. Previous studies on CLS mainly take pipeline methods or train the end-to-end model using the tra…
Abstractive Text SummarizationCross-Lingual Abstractive SummarizationDecoderSentence