paper-with-me

Papers

Investigating Table-to-Text Generation Capabilities of LLMs in Real-World Information Seeking Scenarios

2023-05-24 · Yilun Zhao, Haowei Zhang, Shengyun Si, Linyong Nan, Xiangru Tang, Arman Cohan

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown enormous potential to improve user efficiency. However, the adoption of LLMs in real-world applications for table information seeking remains underexplored. In this paper, we investigate the table-to-text capabilities of different LLMs using four datasets within two real-world information seeking scenarios. These include the LogicNLG and our newly-constructed LoTNLG datasets for data insight generation, along with the FeTaQA and our newly-constructed F2WTQ datasets for query-based generation. We structure our investigation around three research questions, evaluating the performance of LLMs in table-to-text generation, automated evaluation, and feedback generation, respectively. Experimental results indicate that the current high-performing LLM, specifically GPT-4, can effectively serve as a table-to-text generator, evaluator, and feedback generator, facilitating users' information seeking purposes in real-world scenarios. However, a significant performance gap still exists between other open-sourced LLMs (e.g., Tulu and LLaMA-2) and GPT-4 models. Our data and code are publicly available at https://github.com/yale-nlp/LLM-T2T.

📄 PDF Abstract BibTeX arXiv:2305.14987

Code (2)

yale-nlp/llm-t2t 공식 구현
yilunzhao/llm-t2t 공식 구현

Tasks

Table-to-Text GenerationText Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

QUENCH: Measuring the gap between Indic and Non-Indic Contextual General Reasoning in LLMs

2024-12-16 · Mohammad Aflah Khan, Neemesh Yadav, Sarah Masud, Md. Shad Akhtar

The rise of large language models (LLMs) has created a need for advanced benchmarking systems beyond traditional setups. To this end, we introduce QUENCH, a novel text-based English Quizzing Benchmark manually curated an…

BenchmarkingCommon Sense ReasoningWorld Knowledge

Crafting a Good Prompt or Providing Exemplary Dialogues? A Study of In-Context Learning for Persona-based Dialogue Generation

2024-02-15 · Jiashu Pu, Yajing Wan, Yuru Zhang, Jing Chen 외

Previous in-context learning (ICL) research has focused on tasks such as classification, machine translation, text2table, etc., while studies on whether ICL can improve human-like dialogue generation are scarce. Our work…

Dialogue GenerationDiversityIn-Context LearningMachine Translation

Investigating Answerability of LLMs for Long-Form Question Answering

2023-09-15 · Meghana Moorthy Bhat, Rui Meng, Ye Liu, Yingbo Zhou 외

As we embark on a new era of LLMs, it becomes increasingly crucial to understand their capabilities, limitations, and differences. Toward making further progress in this direction, we strive to build a deeper understandi…

FormLong Form Question AnsweringQuestion AnsweringQuestion Generation+1

Automatically Generating Hard Math Problems from Hypothesis-Driven Error Analysis

2026-04-06 · Jiayu Fu, Mourad Heddaya, Chenhao Tan arxiv

Numerous math benchmarks exist to evaluate LLMs' mathematical capabilities. However, most involve extensive manual effort and are difficult to scale. Consequently, they cannot keep pace with LLM development or easily pro…

Towards the Holographic Characteristic of LLMs for Efficient Short-text Generation

2026-01-30 · Shun Qian, Bingquan Liu, Chengjie Sun, Zhen Xu 외 arxiv

The recent advancements in Large Language Models (LLMs) have attracted interest in exploring their in-context learning abilities and chain-of-thought capabilities. However, there are few studies investigating the specifi…

Text Generation