paper-with-me

홈 › Papers

Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations

2020-11-03 · EMNLP (spnlp) 2020 11 · Ke Tran, Ming Tan

Modern conversational AI systems support natural language understanding for a wide variety of capabilities. While a majority of these tasks can be accomplished using a simple and flat representation of intents and slots, more sophisticated capabilities require complex hierarchical representations supported by semantic parsing. State-of-the-art semantic parsers are trained using supervised learning with data labeled according to a hierarchical schema which might be costly to obtain or not readily available for a new domain. In this work, we explore the possibility of generating synthetic data for neural semantic parsing using a pretrained denoising sequence-to-sequence model (i.e., BART). Specifically, we first extract masked templates from the existing labeled utterances, and then fine-tune BART to generate synthetic utterances conditioning on the extracted templates. Finally, we use an auxiliary parser (AP) to filter the generated utterances. The AP guarantees the quality of the generated data. We show the potential of our approach when evaluating on the Facebook TOP dataset for navigation domain.

📄 PDF Abstract BibTeX arXiv:2011.02050

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingNatural Language UnderstandingSemantic Parsing

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentation

2025-12-18 · Yunkai Yang, Yudong Zhang, Kunquan Zhang, Jinxiao Zhang 외 arxiv

With the rapid progress of controllable generation, training data synthesis has become a promising way to expand labeled datasets and alleviate manual annotation in remote sensing (RS). However, the complexity of semanti…

Semantic Segmentation

Making Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests

2024-06-12 · Amogh Mannekote, Jinseok Nam, Ziming Li, Jian Gao 외

Indirect User Requests (IURs), such as "It's cold in here" instead of "Could you please increase the temperature?" are common in human-human task-oriented dialogue and require world knowledge and pragmatic reasoning from…

Dialogue State TrackingNatural Language UnderstandingTask-Oriented Dialogue SystemsWorld Knowledge

More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking

2023-03-17 · A. Coca, B. H. Tseng, W. Lin, B. Byrne

The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical …

Dialogue State TrackingDiversity

SVDTree: Semantic Voxel Diffusion for Single Image Tree Reconstruction

2024-01-01 · CVPR 2024 1 · Yuan Li, Zhihao Liu, Bedrich Benes, Xiaopeng Zhang 외

Efficiently representing and reconstructing the 3D geometry of biological trees remains a challenging problem in computer vision and graphics. We propose a novel approach for generating realistic tree models from sin…

3D geometry

Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog

2022-10-17 · Haipeng Sun, Junwei Bao, Youzheng Wu, Xiaodong He

Traditional end-to-end task-oriented dialog systems first convert dialog context into belief state and action state before generating the system response. The system response performance is significantly affected by the …

Contrastive Learning