Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations
Modern conversational AI systems support natural language understanding for a wide variety of capabilities. While a majority of these tasks can be accomplished using a simple and flat representation of intents and slots, more sophisticated capabilities require complex hierarchical representations supported by semantic parsing. State-of-the-art semantic parsers are trained using supervised learning with data labeled according to a hierarchical schema which might be costly to obtain or not readily available for a new domain. In this work, we explore the possibility of generating synthetic data for neural semantic parsing using a pretrained denoising sequence-to-sequence model (i.e., BART). Specifically, we first extract masked templates from the existing labeled utterances, and then fine-tune BART to generate synthetic utterances conditioning on the extracted templates. Finally, we use an auxiliary parser (AP) to filter the generated utterances. The AP guarantees the quality of the generated data. We show the potential of our approach when evaluating on the Facebook TOP dataset for navigation domain.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingNatural Language UnderstandingSemantic ParsingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentation
With the rapid progress of controllable generation, training data synthesis has become a promising way to expand labeled datasets and alleviate manual annotation in remote sensing (RS). However, the complexity of semanti…
Semantic SegmentationMaking Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests
Indirect User Requests (IURs), such as "It's cold in here" instead of "Could you please increase the temperature?" are common in human-human task-oriented dialogue and require world knowledge and pragmatic reasoning from…
Dialogue State TrackingNatural Language UnderstandingTask-Oriented Dialogue SystemsWorld KnowledgeMore Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking
The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical …
Dialogue State TrackingDiversitySVDTree: Semantic Voxel Diffusion for Single Image Tree Reconstruction
Efficiently representing and reconstructing the 3D geometry of biological trees remains a challenging problem in computer vision and graphics. We propose a novel approach for generating realistic tree models from sin…
3D geometryMars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog
Traditional end-to-end task-oriented dialog systems first convert dialog context into belief state and action state before generating the system response. The system response performance is significantly affected by the …
Contrastive Learning