Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models
This paper addresses the problem of generating table captions for scholarly documents, which often require additional information outside the table. To this end, we propose a method of retrieving relevant sentences from the paper body, and feeding the table content as well as the retrieved sentences into pre-trained language models (e.g. T5 and GPT-2) for generating table captions. The contributions of this paper are: (1) discussion on the challenges in table captioning for scholarly documents; (2) development of a dataset DocBank-TB, which is publicly available; and (3) comparison of caption generation methods for scholarly documents with different strategies to retrieve relevant sentences from the paper body. Our experimental results showed that T5 is the better generation model for this task, as it outperformed GPT-2 in BLEU and METEOR implying that the generated text are clearer and more precise. Moreover, inputting relevant sentences matching the row header or whole table is effective.
Code (1)
Tasks
Caption GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioning
In scholarly documents, figures provide a straightforward way of communicating scientific findings to readers. Automating figure caption generation helps move model understandings of scientific documents beyond text and …
Caption GenerationImage CaptioningOptical Character Recognition (OCR)SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval
Multi-modal information retrieval (MMIR) is a rapidly evolving field, where significant progress, particularly in image-text pairing, has been made through advanced representation learning and cross-modality alignment re…
BenchmarkingImage CaptioningInformation RetrievalRepresentation Learning+1Deduplication of Scholarly Documents using Locality Sensitive Hashing and Word Embeddings
Deduplication is the task of identifying near and exact duplicate data items in a collection. In this paper, we present a novel method for deduplication of scholarly documents. We develop a hybrid model which uses struct…
Word EmbeddingsParsing AUC result-figures in machine learning specific scholarly documents for semantically-enriched summarization
Machine learning specific scholarly full-text documents contain a number of result-figures expressing valuable data, including experimental results, evaluations, and cross-model comparisons. The scholarly search system o…
Overview of the Third Workshop on Scholarly Document Processing
With the ever-increasing pace of research and high volume of scholarly communication, scholars face a daunting task. Not only must they keep up with the growing literature in their own and related fields, scholars increa…
Document SummarizationGraph GenerationInformation RetrievalMulti-Document Summarization+2