paper-with-me

Papers

Extracting Procedural Knowledge from Technical Documents

2020-10-20 · Shivali Agarwal, Shubham Atreja, Vikas Agarwal

Procedures are an important knowledge component of documents that can be leveraged by cognitive assistants for automation, question-answering or driving a conversation. It is a challenging problem to parse big dense documents like product manuals, user guides to automatically understand which parts are talking about procedures and subsequently extract them. Most of the existing research has focused on extracting flows in given procedures or understanding the procedures in order to answer conceptual questions. Identifying and extracting multiple procedures automatically from documents of diverse formats remains a relatively less addressed problem. In this work, we cover some of this ground by -- 1) Providing insights on how structural and linguistic properties of documents can be grouped to define types of procedures, 2) Analyzing documents to extract the relevant linguistic and structural properties, and 3) Formulating procedure identification as a classification problem that leverages the features of the document derived from the above analysis. We first implemented and deployed unsupervised techniques which were used in different use cases. Based on the evaluation in different use cases, we figured out the weaknesses of the unsupervised approach. We then designed an improved version which was supervised. We demonstrate that our technique is effective in identifying procedures from big and complex documents alike by achieving accuracy of 89%.

📄 PDF Abstract BibTeX arXiv:2010.10156

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering

Similar Papers 제목 키워드 기반

A Conglomerate of Multiple OCR Table Detection and Extraction

2020-10-16 · Smita Pallavi, Raj Ratn Pranesh, Sumit Kumar

Information representation as tables are compact and concise method that eases searching, indexing, and storage requirements. Extracting and cloning tables from parsable documents is easier and widely used, however indus…

Optical Character Recognition (OCR)Table Detection

Pipelines for Procedural Information Extraction from Scientific Literature: Towards Recipes using Machine Learning and Data Science

2019-12-16 · Huichen Yang, Carlos A. Aguirre, Maria F. De La Torre, Derek Christensen 외

This paper describes a machine learning and data science pipeline for structured information extraction from documents, implemented as a suite of open-source tools and extensions to existing tools. It centers around a me…

BIG-bench Machine LearningEntity Extraction using GANInformation RetrievalManagement+2

Unfolding the Structure of a Document using Deep Learning

2019-09-29 · Muhammad Mahbubur Rahman, Tim Finin

Understanding and extracting of information from large documents, such as business opportunities, academic articles, medical documents and technical reports, poses challenges not present in short documents. Such large do…

ArticlesDeep Learning

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models

2024-11-19 · Laura Ruis, Maximilian Mozes, Juhan Bae, Siddhartha Rao Kamalakara 외

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to so…

Mathematical Reasoning

Application Of Large Language Models For The Extraction Of Information From Particle Accelerator Technical Documentation

2025-09-02 · Qing Dai, Rasmus Ischebeck, Maruisz Sapinski, Adam Grycner arxiv

The large set of technical documentation of legacy accelerator systems, coupled with the retirement of experienced personnel, underscores the urgent need for efficient methods to preserve and transfer specialized knowled…