Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding
Semantic parsing is one of the key components of natural language understanding systems. A successful parse transforms an input utterance to an action that is easily understood by the system. Many algorithms have been proposed to solve this problem, from conventional rulebased or statistical slot-filling systems to shiftreduce based neural parsers. For complex parsing tasks, the state-of-the-art method is based on autoregressive sequence to sequence models to generate the parse directly. This model is slow at inference time, generating parses in O(n) decoding steps (n is the length of the target sequence). In addition, we demonstrate that this method performs poorly in zero-shot cross-lingual transfer learning settings. In this paper, we propose a non-autoregressive parser which is based on the insertion transformer to overcome these two issues. Our approach 1) speeds up decoding by 3x while outperforming the autoregressive model and 2) significantly improves cross-lingual transfer in the low-resource setting by 37% compared to autoregressive baseline. We test our approach on three well-known monolingual datasets: ATIS, SNIPS and TOP. For cross lingual semantic parsing, we use the MultiATIS++ and the multilingual TOP datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferNatural Language UnderstandingSemantic Parsingslot-fillingSlot FillingTransfer LearningZero-Shot Cross-Lingual TransferSimilar Papers 제목 키워드 기반
Semantic Parsing in Task-Oriented Dialog with Recursive Insertion-based Encoder
We introduce a Recursive INsertion-based Encoder (RINE), a novel approach for semantic parsing in task-oriented dialog. Our model consists of an encoder network that incrementally builds the semantic parse tree by predic…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Nested Named Entity Recognition+1Point2Insert: Video Object Insertion via Sparse Point Guidance
This paper introduces Point2Insert, a sparse-point-based framework for flexible and user-friendly object insertion in videos, motivated by the growing popularity of accurate, low-effort object placement. Existing approac…
FreeInsert: Disentangled Text-Guided Object Insertion in 3D Gaussian Scene without Spatial Priors
Text-driven object insertion in 3D scenes is an emerging task that enables intuitive scene editing through natural language. However, existing 2D editing-based methods often rely on spatial priors such as 2D masks or 3D …
ObjectSpatial ReasoningEntity Insertion in Multilingual Linked Corpora: The Case of Wikipedia
Links are a fundamental part of information networks, turning isolated pieces of knowledge into a network of information that is much richer than the sum of its parts. However, adding a new link to the network is not tri…
Learning Cross-lingual Distributed Logical Representations for Semantic Parsing
With the development of several multilingual datasets used for semantic parsing, recent research efforts have looked into the problem of learning semantic parsers in a multilingual setup. However, how to improve the perf…
Semantic Parsing