Semantic-aware Contrastive Learning for More Accurate Semantic Parsing
Since the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an autoregressive fashion. In this paper, we propose a semantic-aware contrastive learning algorithm, which can learn to distinguish fine-grained meaning representations and take the overall sequence-level semantic into consideration. Specifically, a multi-level online sampling algorithm is proposed to sample confusing and diverse instances. Three semantic-aware similarity functions are designed to accurately measure the distance between meaning representations as a whole. And a ranked contrastive loss is proposed to pull the representations of the semantic-identical instances together and push negative instances away. Experiments on two standard datasets show that our approach achieves significant improvements over MLE baselines and gets state-of-the-art performances by simply applying semantic-aware contrastive learning on a vanilla Seq2Seq model.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningSemantic ParsingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic-Aware Dual Contrastive Learning for Multi-label Image Classification
Extracting image semantics effectively and assigning corresponding labels to multiple objects or attributes for natural images is challenging due to the complex scene contents and confusing label dependencies. Recent wor…
Contrastive Learningimage-classificationImage ClassificationMulti-Label Image Classification+2KAAE: Numerical Reasoning for Knowledge Graphs via Knowledge-aware Attributes Learning
Numerical reasoning is pivotal in various artificial intelligence applications, such as natural language processing and recommender systems, where it involves using entities, relations, and attribute values (e.g., weight…
AttributeContrastive LearningKnowledge Graph EmbeddingsKnowledge Graphs+2Keyword-Based Diverse Image Retrieval by Semantics-aware Contrastive Learning and Transformer
In addition to relevance, diversity is an important yet less studied performance metric of cross-modal image retrieval systems, which is critical to user experience. Existing solutions for diversity-aware image retrieval…
Contrastive LearningDiversityImage RetrievalRetrievalHC$^2$L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding
State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its co…
Contrastive LearningSpoken Language UnderstandingDAPO: Design Structure-Aware Pass Ordering in High-Level Synthesis with Graph Contrastive and Reinforcement Learning
High-Level Synthesis (HLS) tools are widely adopted in FPGA-based domain-specific accelerator design. However, existing tools rely on fixed optimization strategies inherited from software compilations, limiting their eff…
Reinforcement LearningContrastive Learning