Open Information Extraction on Scientific Text: An Evaluation
Open Information Extraction (OIE) is the task of the unsupervised creation of structured information from text. OIE is often used as a starting point for a number of downstream tasks including knowledge base construction, relation extraction, and question answering. While OIE methods are targeted at being domain independent, they have been evaluated primarily on newspaper, encyclopedic or general web text. In this article, we evaluate the performance of OIE on scientific texts originating from 10 different disciplines. To do so, we use two state-of-the-art OIE systems applying a crowd-sourcing approach. We find that OIE systems perform significantly worse on scientific text than encyclopedic text. We also provide an error analysis and suggest areas of work to reduce errors. Our corpus of sentences and judgments are made available.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge Base ConstructionOpen Information ExtractionQuestion AnsweringRelation ExtractionSimilar Papers 제목 키워드 기반
In Layman's Terms: Semi-Open Relation Extraction from Scientific Texts
Information Extraction (IE) from scientific texts can be used to guide readers to the central information in scientific documents. But narrow IE systems extract only a fraction of the information captured, and Open IE sy…
RelationRelation ExtractionAutomated, LLM enabled extraction of synthesis details for reticular materials from scientific literature
Automated knowledge extraction from scientific literature can potentially accelerate materials discovery. We have investigated an approach for extracting synthesis protocols for reticular materials from scientific litera…
HallucinationIn-Context LearningPrompt EngineeringRule Based Metadata Extraction Framework from Academic Articles
Metadata of scientific articles such as title, abstract, keywords or index terms, body text, conclusion, reference and others play a decisive role in collecting, managing and storing academic data in scientific databases…
ArticlesA Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images
Scientific figures and tables encode essential experimental evidence, yet remain difficult for digital libraries and multimodal AI systems to retrieve and interpret. The ALD/E-ImageMiner benchmark and ICDAR 2026 Competit…
Visual Question AnsweringInformation ExtractionSTRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking
The ability to extract structured information from unstructured sources-such as free-text documents and scientific literature-is critical for accelerating scientific discovery and knowledge synthesis. Large Language Mode…
BenchmarkingNavigatescientific discovery