Inducing and Using Alignments for Transition-based AMR Parsing
Transition-based parsers for Abstract Meaning Representation (AMR) rely on node-to-word alignments. These alignments are learned separately from parser training and require a complex pipeline of rule-based components, pre-processing, and post-processing to satisfy domain-specific constraints. Parsers also train on a point-estimate of the alignment pipeline, neglecting the uncertainty due to the inherent ambiguity of alignment. In this work we explore two avenues for overcoming these limitations. First, we propose a neural aligner for AMR that learns node-to-word alignments without relying on complex pipelines. We subsequently explore a tighter integration of aligner and parser training by considering a distribution over oracle action sequences arising from aligner uncertainty. Empirical results show this approach leads to more accurate alignments and generalization better from the AMR2.0 to AMR3.0 corpora. We attain a new state-of-the art for gold-only trained models, matching silver-trained performance without the need for beam search on AMR3.0.
Code (2)
Tasks
Abstract Meaning RepresentationAMR ParsingSimilar Papers 제목 키워드 기반
AMR Parsing with Action-Pointer Transformer
Abstract Meaning Representation parsing is a sentence-to-graph prediction task where target nodes are not explicitly aligned to sentence tokens. However, since graph nodes are semantically based on one or more sentence t…
Abstract Meaning RepresentationAMR ParsingHard AttentionInductive Bias+1Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing
Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and …
Abstract Meaning RepresentationAMR ParsingDecoderSentenceStructure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing
Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and …
Abstract Meaning RepresentationAMR ParsingDecoderSentenceSlide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document AMR Parsing
The sliding window approach provides an elegant way to handle contexts of sizes larger than the Transformer's input window, for tasks like language modeling. Here we extend this approach to the sequence-to-sequence task …
Abstract Meaning RepresentationAMR ParsingLanguage ModelingLanguage Modelling+1Neural Machine Translation for Query Construction and Composition
Research on question answering with knowledge base has recently seen an increasing use of deep architectures. In this extended abstract, we study the application of the neural machine translation paradigm for question pa…
Code GenerationKnowledge Base Question AnsweringSemantic ParsingTranslation