Cross-lingual Zero Pronoun Resolution

2020-05-01 · LREC 2020 5 · Abdulrahman Aloraini, Massimo Poesio

In languages like Arabic, Chinese, Italian, Japanese, Korean, Portuguese, Spanish, and many others, predicate arguments in certain syntactic positions are not realized instead of being realized as overt pronouns, and are thus called zero- or null-pronouns. Identifying and resolving such omitted arguments is crucial to machine translation, information extraction and other NLP tasks, but depends heavily on semantic coherence and lexical relationships. We propose a BERT-based cross-lingual model for zero pronoun resolution, and evaluate it on the Arabic and Chinese portions of OntoNotes 5.0. As far as we know, ours is the first neural model of zero-pronoun resolution for Arabic; and our model also outperforms the state-of-the-art for Chinese. In the paper we also evaluate BERT feature extraction and fine-tune models on the task, and compare them with our model. We also report on an investigation of BERT layers indicating which layer encodes the most suitable representation for the task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation Translation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Weight Decay 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Adam 설명 없음

Multi-Head Attention 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Anaphoric Zero Pronoun Identification: A Multilingual Approach

2020-12-01 · COLING (CRAC) 2020 12 · Abdulrahman Aloraini, Massimo Poesio

Pro-drop languages such as Arabic, Chinese, Italian or Japanese allow morphologically null but referential arguments in certain syntactic positions, called anaphoric zero-pronouns. Much NLP work on anaphoric zero-pronoun…

Transfer Learning

Cross-lingual Coreference Resolution of Pronouns

2014-08-01 · COLING 2014 8 · Michal Nov{\'a}k, Zden{\v{e}}k {\v{Z}}abokrtsk{\'y}

coreference-resolution Coreference Resolution Machine Translation Part-Of-Speech Tagging

Latent Anaphora Resolution for Cross-Lingual Pronoun Prediction

2013-10-01 · EMNLP 2013 10 · Christian Hardmeier, J{\"o}rg Tiedemann, Joakim Nivre

Machine Translation Prediction

Semantic-aware Chinese Zero Pronoun Resolution with Pre-trained Semantic Dependency Parser

2020-10-01 · CCL 2020 10 · Lanqiu Zhang, Zizhuo Shen, Yanqiu Shao

Deep learning-based Chinese zero pronoun resolution model has achieved better performance than traditional machine learning-based model. However, the existing work related to Chinese zero pronoun resolution has not yet w…

Chinese Zero Pronoun Resolution Deep Learning

Zero Pronoun Resolution with Attention-based Neural Network

2018-08-01 · COLING 2018 8 · Qingyu Yin, Yu Zhang, Wei-Nan Zhang, Ting Liu 외

Recent neural network methods for zero pronoun resolution explore multiple models for generating representation vectors for zero pronouns and their candidate antecedents. Typically, contextual information is utilized to …

Chinese Zero Pronoun Resolution