paper-with-me

Papers

Automatic Metadata Extraction Incorporating Visual Features from Scanned Electronic Theses and Dissertations

2021-07-01 · Muntabir Hasan Choudhury, Himarsha R. Jayanetti, Jian Wu, William A. Ingram, Edward A. Fox

Electronic Theses and Dissertations (ETDs) contain domain knowledge that can be used for many digital library tasks, such as analyzing citation networks and predicting research trends. Automatic metadata extraction is important to build scalable digital library search engines. Most existing methods are designed for born-digital documents, so they often fail to extract metadata from scanned documents such as for ETDs. Traditional sequence tagging methods mainly rely on text-based features. In this paper, we propose a conditional random field (CRF) model that combines text-based and visual features. To verify the robustness of our model, we extended an existing corpus and created a new ground truth corpus consisting of 500 ETD cover pages with human validated metadata. Our experiments show that CRF with visual features outperformed both a heuristic and a CRF model with only text-based features. The proposed model achieved 81.3%-96% F1 measure on seven metadata fields. The data and source code are publicly available on Google Drive (https://tinyurl.com/y8kxzwrp) and a GitHub repository (https://github.com/lamps-lab/ETDMiner/tree/master/etd_crf), respectively.

📄 PDF Abstract BibTeX arXiv:2107.00516

Code (2)

lamps-lab/AutoMeta 공식 구현
lamps-lab/ETDMiner

Tasks

Key Information ExtractionOptical Character Recognition (OCR)

Methods 이 논문이 사용한 방법론

CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…

Similar Papers 제목 키워드 기반

From Pixels to Prices with ViTMAE: Integrating Real Estate Images through Masked Autoencoder Vision Transformers (ViTMAE) with Conventional Real Estate Data for Enhanced Automated Valuation

2024-04-20 · journal 2024 4 · Ekblad Voltaire, Fanny

The integration of Vision Transformers (ViTs) using Masked Autoencoder pre-training (ViTMAE) into real estate valuation is investigated in this Master’s thesis, addressing the challenge of effectively analyzing visual in…

LAME: Layout Aware Metadata Extraction Approach for Research Articles

2021-12-23 · Jongyun Choi, Hyesoo Kong, Hwamook Yoon, Heung-Seon Oh 외

The volume of academic literature, such as academic conference papers and journals, has increased rapidly worldwide, and research on metadata extraction is ongoing. However, high-performing metadata extraction is still c…

ArticlesDiversity

Harvest -- An Open Source Toolkit for Extracting Posts and Post Metadata from Web Forums

2021-02-03 · Albert Weichselbraun, Adrian M. P. Brasoveanu, Roger Waldvogel, Fabian Odoni

Automatic extraction of forum posts and metadata is a crucial but challenging task since forums do not expose their content in a standardized structure. Content extraction methods, therefore, often need customizations su…

EXIF as Language: Learning Cross-Modal Associations Between Images and Camera Metadata

2023-01-11 · CVPR 2023 1 · Chenhao Zheng, Ayush Shrivastava, Andrew Owens

We learn a visual representation that captures information about the camera that recorded a given photo. To do this, we train a multimodal embedding between image patches and the EXIF metadata that cameras automatically …

ClusteringImage Forensics

New Methods for Metadata Extraction from Scientific Literature

2017-10-27 · Dominika Tkaczyk

Within the past few decades we have witnessed digital revolution, which moved scholarly communication to electronic media and also resulted in a substantial increase in its volume. Nowadays keeping track with the latest …

Articles