Syntax in End-to-End Natural Language Processing

2021-11-01 · EMNLP (ACL) 2021 11 · Hai Zhao, Rui Wang, Kehai Chen

This tutorial surveys the latest technical progress of syntactic parsing and the role of syntax in end-to-end natural language processing (NLP) tasks, in which semantic role labeling (SRL) and machine translation (MT) are the representative NLP tasks that have always been beneficial from informative syntactic clues since a long time ago, though the advance from end-to-end deep learning models shows new results. In this tutorial, we will first introduce the background and the latest progress of syntactic parsing and SRL/NMT. Then, we will summarize the key evidence about the syntactic impacts over these two concerning tasks, and explore the behind reasons from both computational and linguistic backgrounds.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTSemantic Role Labeling Translation

Book Reviews: Linguistic Fundamentals for Natural Language Processing: 100 Essentials from Morphology and Syntax by Emily M. Bender

2015-03-01 · CL 2015 3 · Chris Dyer

Benchmarking Language Models for Code Syntax Understanding

2022-10-26 · Da Shen, Xinyun Chen, Chenguang Wang, Koushik Sen 외

Pre-trained language models have demonstrated impressive performance in both natural language processing and program understanding, which represent the input as a token sequence without explicitly modeling its structure.…

Benchmarking

Explainable Natural Language to Bash Translation using Abstract Syntax Tree

2021-11-01 · CoNLL (EMNLP) 2021 11 · Shikhar Bharadwaj, Shirish Shevade

Natural language processing for program synthesis has been widely researched. In this work, we focus on generating Bash commands from natural language invocations with explanations. We propose a novel transformer based s…

Program Synthesis Translation

Syntax-based Attention Model for Natural Language Inference

2016-07-22 · PengFei Liu, Xipeng Qiu, Xuanjing Huang

Introducing attentional mechanism in neural network is a powerful concept, and has achieved impressive results in many natural language processing tasks. However, most of the existing models impose attentional distributi…

model Natural Language Inference Sentence

Attentive Semantic Role Labeling with Boundary Indicator

2018-09-08 · Zhuosheng Zhang, Shexia He, Zuchao Li, Hai Zhao

The goal of semantic role labeling (SRL) is to discover the predicate-argument structure of a sentence, which plays a critical role in deep processing of natural language. This paper introduces simple yet effective auxil…

Semantic Role Labeling Sentence