paper-with-me

Papers

A Syntax-aware Multi-task Learning Framework for Chinese Semantic Role Labeling

2019-11-12 · IJCNLP 2019 11 · Qingrong Xia, Zhenghua Li, Min Zhang

Semantic role labeling (SRL) aims to identify the predicate-argument structure of a sentence. Inspired by the strong correlation between syntax and semantics, previous works pay much attention to improve SRL performance on exploiting syntactic knowledge, achieving significant results. Pipeline methods based on automatic syntactic trees and multi-task learning (MTL) approaches using standard syntactic trees are two common research orientations. In this paper, we adopt a simple unified span-based model for both span-based and word-based Chinese SRL as a strong baseline. Besides, we present a MTL framework that includes the basic SRL module and a dependency parser module. Different from the commonly used hard parameter sharing strategy in MTL, the main idea is to extract implicit syntactic representations from the dependency parser as external inputs for the basic SRL model. Experiments on the benchmarks of Chinese Proposition Bank 1.0 and CoNLL-2009 Chinese datasets show that our proposed framework can effectively improve the performance over the strong baselines. With the external BERT representations, our framework achieves new state-of-the-art 87.54 and 88.5 F1 scores on the two test data of the two benchmarks, respectively. In-depth analysis are conducted to gain more insights on the proposed framework and the effectiveness of syntax.

📄 PDF Abstract BibTeX arXiv:1911.04641

Code (1)

KiroSummer/A_Syntax-aware_MTL_Framework_for_Chinese_SRL 공식 구현 pytorch

Tasks

Chinese Semantic Role LabelingMulti-Task LearningSemantic Role LabelingSentence

Methods 이 논문이 사용한 방법론

Test 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

A Unified Syntax-aware Framework for Semantic Role Labeling

2018-10-01 · EMNLP 2018 10 · Zuchao Li, Shexia He, Jiaxun Cai, Zhuosheng Zhang 외

Semantic role labeling (SRL) aims to recognize the predicate-argument structure of a sentence. Syntactic information has been paid a great attention over the role of enhancing SRL. However, the latest advance shows that …

Machine TranslationQuestion AnsweringSemantic Role LabelingSentence

CSED: A Chinese Semantic Error Diagnosis Corpus

2023-05-09 · Bo Sun, Baoxin Wang, YiXuan Wang, Wanxiang Che 외

Recently, much Chinese text error correction work has focused on Chinese Spelling Check (CSC) and Chinese Grammatical Error Diagnosis (CGED). In contrast, little attention has been paid to the complicated problem of Chin…

Syntax-Enhanced Neural Machine Translation with Syntax-Aware Word Representations

2019-05-08 · NAACL 2019 6 · Meishan Zhang, Zhenghua Li, Guohong Fu, Min Zhang

Syntax has been demonstrated highly effective in neural machine translation (NMT). Previous NMT models integrate syntax by representing 1-best tree outputs from a well-trained parsing system, e.g., the representative Tre…

Machine TranslationNMTTranslationWord Embeddings

SaGE: 基于句法感知图卷积神经网络和ELECTRA的中文隐喻识别模型(SaGE: Syntax-aware GCN with ELECTRA for Chinese Metaphor Detection)

2021-08-01 · CCL 2021 8 · Shenglong Zhang, Ying Liu, Yanjun Ma

“隐喻是人类语言中经常出现的一种特殊现象,隐喻识别对于自然语言处理各项任务来说具有十分基础和重要的意义。针对中文领域的隐喻识别任务,我们提出了一种基于句法感知图卷积神经网络和ELECTRA的隐喻识别模型(Syntax-aware GCN withELECTRA SaGE)。该模型从语言学出发,使用ELECTRA和Transformer编码器抽取句子的语义特征,将句子按照依存关系组织成一张图并使用图卷积神经网络抽取其句法特征,在此基础上对…

A Full End-to-End Semantic Role Labeler, Syntax-agnostic Over Syntax-aware?

2018-08-11 · Jiaxun Cai, Shexia He, Zuchao Li, Hai Zhao

Semantic role labeling (SRL) is to recognize the predicate-argument structure of a sentence, including subtasks of predicate disambiguation and argument labeling. Previous studies usually formulate the entire SRL problem…

DecoderSemantic Role LabelingSentence