paper-with-me

홈 › Papers

Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints

2024-09-22 · Kaikai An, Shuzheng Si, Helan Hu, Haozhe Zhao, Yuchi Wang, Qingyan Guo, Baobao Chang

Semantic Parsing aims to capture the meaning of a sentence and convert it into a logical, structured form. Previous studies show that semantic parsing enhances the performance of smaller models (e.g., BERT) on downstream tasks. However, it remains unclear whether the improvements extend similarly to LLMs. In this paper, our empirical findings reveal that, unlike smaller models, directly adding semantic parsing results into LLMs reduces their performance. To overcome this, we propose SENSE, a novel prompting approach that embeds semantic hints within the prompt. Experiments show that SENSE consistently improves LLMs' performance across various tasks, highlighting the potential of integrating semantic information to improve LLM capabilities.

📄 PDF Abstract BibTeX arXiv:2409.14469

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic ParsingSentence

Similar Papers 제목 키워드 기반

Retrieval-Augmented Semantic Parsing: Using Large Language Models to Improve Generalization

2024-12-13 · Xiao Zhang, Qianru Meng, Johan Bos

Open-domain semantic parsing remains a challenging task, as models often rely on heuristics and struggle to handle unseen concepts. In this paper, we investigate the potential of large language models (LLMs) for this tas…

DecoderRetrievalSemantic Parsing

Makadi: A Large-Scale Human-Labeled Dataset for Hindi Semantic Parsing

2022-06-01 · WILDRE (LREC) 2022 6 · Shashwat Vaibhav, Nisheeth Srivastava

Parsing natural language queries into formal database calls is a very well-studied problem. Because of the rich diversity of semantic markers across the world’s languages, progress in solving this problem is irreducibly …

DiversityNatural Language QueriesSemantic ParsingText to SQL+1

Filling Memory Gaps: Enhancing Continual Semantic Parsing via SQL Syntax Variance-Guided LLMs without Real Data Replay

2024-12-10 · Ruiheng Liu, Jinyu Zhang, Yanqi Song, Yu Zhang 외

Continual Semantic Parsing (CSP) aims to train parsers to convert natural language questions into SQL across tasks with limited annotated examples, adapting to the real-world scenario of dynamically updated databases. Pr…

Continual LearningLanguage ModelingLanguage ModellingLarge Language Model+1

ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs

2022-04-19 · Findings (NAACL) 2022 7 · Liang Chen, Peiyi Wang, Runxin Xu, Tianyu Liu 외

As Abstract Meaning Representation (AMR) implicitly involves compound semantic annotations, we hypothesize auxiliary tasks which are semantically or formally related can better enhance AMR parsing. We find that 1) Semant…

Abstract Meaning RepresentationAMR ParsingDependency ParsingSemantic Role Labeling

AMRize, then Parse! Enhancing AMR Parsing with PseudoAMR Data

2021-11-16 · ACL ARR November 2021 11 · Anonymous

As Abstract Meaning Representation (AMR) implicitly involves compound semantic annotations, we hypothesize auxiliary tasks which are semantically or formally related can better enhance AMR parsing. With carefully designe…

Abstract Meaning RepresentationAMR ParsingDependency ParsingSemantic Role Labeling