paper-with-me

홈 › Papers

Universal Recurrent Neural Network Grammar

2021-10-01 · ROCLING 2021 10 · Chinmay Choudhary, Colm O’riordan

Modern approaches to Constituency Parsing are mono-lingual supervised approaches which require large amount of labelled data to be trained on, thus limiting their utility to only a handful of high-resource languages. To address this issue of data-sparsity for low-resource languages we propose Universal Recurrent Neural Network Grammars (UniRNNG) which is a multi-lingual variant of the popular Recurrent Neural Network Grammars (RNNG) model for constituency parsing. UniRNNG involves Cross-lingual Transfer Learning for Constituency Parsing task. The architecture of UniRNNG is inspired by Principle and Parameter theory proposed by Noam Chomsky. UniRNNG utilises the linguistic typology knowledge available as feature-values within WALS database, to generalize over multiple languages. Once trained on sufficiently diverse polyglot corpus UniRNNG can be applied to any natural language thus making it Language-agnostic constituency parser. Experiments reveal that our proposed UniRNNG outperform state-of-the-art baseline approaches for most of the target languages, for which these are tested.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Constituency ParsingCross-Lingual TransferTransfer Learning

Similar Papers 제목 키워드 기반

Connecting First and Second Order Recurrent Networks with Deterministic Finite Automata

2019-11-12 · Qinglong Wang, Kaixuan Zhang, Xue Liu, C. Lee Giles

We propose an approach that connects recurrent networks with different orders of hidden interaction with regular grammars of different levels of complexity. We argue that the correspondence between recurrent networks and…

All

Local Grammar-Based Coding Revisited

2022-09-27 · Łukasz Dębowski

In the setting of minimal local grammar-based coding, the input string is represented as a grammar with the minimal output length defined via simple symbol-by-symbol encoding. This paper discusses four contributions to t…

A Comparative Study of Rule Extraction for Recurrent Neural Networks

2018-01-16 · Qinglong Wang, Kaixuan Zhang, Alexander G. Ororbia II, Xinyu Xing 외

Understanding recurrent networks through rule extraction has a long history. This has taken on new interests due to the need for interpreting or verifying neural networks. One basic form for representing stateful rules i…

Rediscovering the Alphabet - On the Innate Universal Grammar

2014-12-08 · M. Yahia Kaadan, Asaad Kaadan

Universal Grammar (UG) theory has been one of the most important research topics in linguistics since introduced five decades ago. UG specifies the restricted set of languages learnable by human brain, and thus, many res…

Transfer Learning

Unsupervised Neural Machine Translation with Universal Grammar

2021-11-01 · EMNLP 2021 11 · Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao

Machine translation usually relies on parallel corpora to provide parallel signals for training. The advent of unsupervised machine translation has brought machine translation away from this reliance, though performance …

Machine TranslationTranslationUnsupervised Machine Translation