paper-with-me

Papers

Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models

2021-08-18 · Junjie H. Xu, Kohei Shinden, Makoto P. Kato

This paper addresses the problem of generating table captions for scholarly documents, which often require additional information outside the table. To this end, we propose a method of retrieving relevant sentences from the paper body, and feeding the table content as well as the retrieved sentences into pre-trained language models (e.g. T5 and GPT-2) for generating table captions. The contributions of this paper are: (1) discussion on the challenges in table captioning for scholarly documents; (2) development of a dataset DocBank-TB, which is publicly available; and (3) comparison of caption generation methods for scholarly documents with different strategies to retrieve relevant sentences from the paper body. Our experimental results showed that T5 is the better generation model for this task, as it outperformed GPT-2 in BLEU and METEOR implying that the generated text are clearer and more precise. Moreover, inputting relevant sentences matching the row header or whole table is effective.

📄 PDF Abstract BibTeX arXiv:2108.08111

Code (1)

junj2ejj/GCCE2021_materials 공식 구현

Tasks

Caption Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Weight Decay 설명 없음
SentencePiece 설명 없음
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…

Similar Papers 제목 키워드 기반

SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioning

2023-06-06 · Zhishen Yang, Raj Dabre, Hideki Tanaka, Naoaki Okazaki

In scholarly documents, figures provide a straightforward way of communicating scientific findings to readers. Automating figure caption generation helps move model understandings of scientific documents beyond text and …

Caption GenerationImage CaptioningOptical Character Recognition (OCR)

SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval

2024-01-24 · Siwei Wu, Yizhi Li, Kang Zhu, Ge Zhang 외

Multi-modal information retrieval (MMIR) is a rapidly evolving field, where significant progress, particularly in image-text pairing, has been made through advanced representation learning and cross-modality alignment re…

BenchmarkingImage CaptioningInformation RetrievalRepresentation Learning+1

Deduplication of Scholarly Documents using Locality Sensitive Hashing and Word Embeddings

2020-05-01 · LREC 2020 5 · Bikash Gyawali, Lucas Anastasiou, Petr Knoth

Deduplication is the task of identifying near and exact duplicate data items in a collection. In this paper, we present a novel method for deduplication of scholarly documents. We develop a hybrid model which uses struct…

Word Embeddings

Parsing AUC result-figures in machine learning specific scholarly documents for semantically-enriched summarization

2021-11-14 · Applied Artificial Intelligence 2021 11 · Iqra Safder, Hafsa Batool, Raheem Sarwar, Farooq Zaman 외

Machine learning specific scholarly full-text documents contain a number of result-figures expressing valuable data, including experimental results, evaluations, and cross-model comparisons. The scholarly search system o…

Overview of the Third Workshop on Scholarly Document Processing

2022-10-01 · sdp (COLING) 2022 10 · Arman Cohan, Guy Feigenblat, Dayne Freitag, Tirthankar Ghosal 외

With the ever-increasing pace of research and high volume of scholarly communication, scholars face a daunting task. Not only must they keep up with the growing literature in their own and related fields, scholars increa…

Document SummarizationGraph GenerationInformation RetrievalMulti-Document Summarization+2