paper-with-me

Papers

AMR Parsing via Graph-Sequence Iterative Inference

2020-04-12 · ACL 2020 6 · Deng Cai, Wai Lam

We propose a new end-to-end model that treats AMR parsing as a series of dual decisions on the input sequence and the incrementally constructed graph. At each time step, our model performs multiple rounds of attention, reasoning, and composition that aim to answer two critical questions: (1) which part of the input \textit{sequence} to abstract; and (2) where in the output \textit{graph} to construct the new concept. We show that the answers to these two questions are mutually causalities. We design a model based on iterative inference that helps achieve better answers in both perspectives, leading to greatly improved parsing accuracy. Our experimental results significantly outperform all previously reported \textsc{Smatch} scores by large margins. Remarkably, without the help of any large-scale pre-trained language model (e.g., BERT), our model already surpasses previous state-of-the-art using BERT. With the help of BERT, we can push the state-of-the-art results to 80.2\% on LDC2017T10 (AMR 2.0) and 75.4\% on LDC2014T12 (AMR 1.0).

📄 PDF Abstract BibTeX arXiv:2004.05572

Code (3)

jcyk/AMR-gs 공식 구현 pytorch
bjascob/amrlib
ibm/graph_ensemble_learning pytorch

Tasks

AMR ParsingLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

JBNU at MRP 2020: AMR Parsing Using a Joint State Model for Graph-Sequence Iterative Inference

2020-11-01 · CONLL 2020 · Seung-Hoon Na, Jinwoo Min

This paper describes the Jeonbuk National University (JBNU) system for the 2020 shared task on Cross-Framework Meaning Representation Parsing at the Conference on Computational Natural Language Learning. Among the five f…

Abstract Meaning RepresentationAMR Parsing

Auto-Parsing Network for Image Captioning and Visual Question Answering

2021-08-24 · ICCV 2021 10 · Xu Yang, Chongyang Gao, Hanwang Zhang, Jianfei Cai

We propose an Auto-Parsing Network (APN) to discover and exploit the input data's hidden tree structures for improving the effectiveness of the Transformer-based vision-language systems. Specifically, we impose a Probabi…

Image CaptioningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

DiscoSG: Towards Discourse-Level Text Scene Graph Parsing through Iterative Graph Refinement

2025-06-18 · Shaoqing Lin, Chong Teng, Fei Li, Donghong Ji 외

Vision-Language Models (VLMs) now generate discourse-level, multi-sentence visual descriptions, challenging text scene graph parsers originally designed for single-sentence caption-to-graph mapping. Current approaches ty…

Graph GenerationHallucinationSentence

ShanghaiTech at MRP 2019: Sequence-to-Graph Transduction with Second-Order Edge Inference for Cross-Framework Meaning Representation Parsing

2020-04-08 · CONLL 2019 11 · Xinyu Wang, Yixian Liu, Zixia Jia, Chengyue Jiang 외

This paper presents the system used in our submission to the \textit{CoNLL 2019 shared task: Cross-Framework Meaning Representation Parsing}. Our system is a graph-based parser which combines an extended pointer-generato…

Variational Inference

Incremental Graph-based Neural Dependency Parsing

2017-09-01 · EMNLP 2017 9 · Xiaoqing Zheng

Very recently, some studies on neural dependency parsers have shown advantage over the traditional ones on a wide variety of languages. However, for graph-based neural dependency parsing systems, they either count on the…

Dependency ParsingTransition-Based Dependency Parsing