paper-with-me

Papers

Beyond Extraction: Contextualising Tabular Data for Efficient Summarisation by Language Models

2024-01-04 · Uday Allu, Biddwan Ahmed, Vishesh Tripathi

The conventional use of the Retrieval-Augmented Generation (RAG) architecture has proven effective for retrieving information from diverse documents. However, challenges arise in handling complex table queries, especially within PDF documents containing intricate tabular structures.This research introduces an innovative approach to enhance the accuracy of complex table queries in RAG-based systems. Our methodology involves storing PDFs in the retrieval database and extracting tabular content separately. The extracted tables undergo a process of context enrichment, concatenating headers with corresponding values. To ensure a comprehensive understanding of the enriched data, we employ a fine-tuned version of the Llama-2-chat language model for summarisation within the RAG architecture. Furthermore, we augment the tabular data with contextual sense using the ChatGPT 3.5 API through a one-shot prompt. This enriched data is then fed into the retrieval database alongside other PDFs. Our approach aims to significantly improve the precision of complex table queries, offering a promising solution to a longstanding challenge in information retrieval.

📄 PDF Abstract BibTeX arXiv:2401.02333

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalLanguage ModelingLanguage ModellingRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
WordPiece 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Towards Personalized and Human-in-the-Loop Document Summarization

2021-08-21 · Samira Ghodratnama

The ubiquitous availability of computing devices and the widespread use of the internet have generated a large amount of data continuously. Therefore, the amount of available information on any given topic is far beyond …

Document SummarizationFeature Engineering

Automatic Speech Summarisation: A Scoping Review

2020-08-27 · Dana Rezazadegan, Shlomo Berkovsky, Juan C. Quiroz, A. Baki Kocaballi 외

Speech summarisation techniques take human speech as input and then output an abridged version as text or speech. Speech summarisation has applications in many domains from information technology to health care, for exam…

Language ModellingSentenceSentence Compression

Automatic summarisation of Instagram social network posts Combining semantic and statistical approaches

2023-03-14 · Kazem Taghandiki, Mohammad Hassan Ahmadi, Elnaz Rezaei Ehsan

The proliferation of data and text documents such as articles, web pages, books, social network posts, etc. on the Internet has created a fundamental challenge in various fields of text processing under the title of "aut…

Articles

archer at SemEval-2021 Task 1: Contextualising Lexical Complexity

2021-08-01 · SEMEVAL 2021 · Irene Russo

Evaluating the complexity of a target word in a sentential context is the aim of the Lexical Complexity Prediction task at SemEval-2021. This paper presents the system created to assess single words lexical complexity, c…

LEMMALexical Complexity Prediction

Leveraging Large Language Models for Zero-shot Lay Summarisation in Biomedicine and Beyond

2025-01-09 · Tomas Goldsack, Carolina Scarton, Chenghua Lin

In this work, we explore the application of Large Language Models to zero-shot Lay Summarisation. We propose a novel two-stage framework for Lay Summarisation based on real-life processes, and find that summaries generat…

Articles