paper-with-me

홈 › Papers

Large Language Models are Complex Table Parsers

2023-12-13 · Bowen Zhao, Changkai Ji, Yuejie Zhang, Wen He, Yingwen Wang, Qing Wang, Rui Feng, Xiaobo Zhang

With the Generative Pre-trained Transformer 3.5 (GPT-3.5) exhibiting remarkable reasoning and comprehension abilities in Natural Language Processing (NLP), most Question Answering (QA) research has primarily centered around general QA tasks based on GPT, neglecting the specific challenges posed by Complex Table QA. In this paper, we propose to incorporate GPT-3.5 to address such challenges, in which complex tables are reconstructed into tuples and specific prompt designs are employed for dialogues. Specifically, we encode each cell's hierarchical structure, position information, and content as a tuple. By enhancing the prompt template with an explanatory description of the meaning of each tuple and the logical reasoning process of the task, we effectively improve the hierarchical structure awareness capability of GPT-3.5 to better parse the complex tables. Extensive experiments and results on Complex Table QA datasets, i.e., the open-domain dataset HiTAB and the aviation domain dataset AIT-QA show that our approach significantly outperforms previous work on both datasets, leading to state-of-the-art (SOTA) performance.

📄 PDF Abstract BibTeX arXiv:2312.11521

Code (0)

등록된 구현이 없습니다.

Tasks

Logical ReasoningQuestion Answering

Methods 이 논문이 사용한 방법론

{Dispute@FaQ-s}How to file a dispute with Expedia? How to file a dispute with Expedia? To file a complaint against Expedia, first try contacting their customer service directly. You can reach them by phone at…
Multi-Head Attention 설명 없음
15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음
Attention 설명 없음
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Evaluating the Impact of Source Code Parsers on ML4SE Models

2022-06-17 · Ilya Utkin, Egor Spirin, Egor Bogomolov, Timofey Bryksin

As researchers and practitioners apply Machine Learning to increasingly more software engineering problems, the approaches they use become more sophisticated. A lot of modern approaches utilize internal code structure in…

Method name prediction

Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion

2022-05-01 · ACL 2022 5 · Chen Zhao, Yu Su, Adam Pauls, Emmanouil Antonios Platanios

Text-to-SQL parsers map natural language questions to programs that are executable over tables to generate answers, and are typically evaluated on large-scale datasets like Spider (Yu et al., 2018). We argue that existin…

Domain GeneralizationSQL ParsingText to SQLText-To-SQL

Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training

2020-12-18 · Peng Shi, Patrick Ng, Zhiguo Wang, Henghui Zhu 외

Most recently, there has been significant interest in learning contextual representations for various NLP tasks, by leveraging large scale text corpora to train large neural language models with self-supervised learning …

Language ModelingLanguage ModellingSelf-Supervised LearningSemantic Parsing+2

Fast Domain Adaptation of Semantic Parsers via Paraphrase Attention

2019-11-01 · WS 2019 11 · Avik Ray, Yilin Shen, Hongxia Jin

Semantic parsers are used to convert user{'}s natural language commands to executable logical form in intelligent personal agents. Labeled datasets required to train such parsers are expensive to collect, and are never c…

Domain Adaptation

Grammar as a Foreign Language

2014-12-23 · NeurIPS 2015 12 · Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov 외

Syntactic constituency parsing is a fundamental problem in natural language processing and has been the subject of intensive research and engineering for decades. As a result, the most accurate parsers are domain specifi…

Constituency ParsingCPU