paper-with-me

Papers

Structured information extraction from complex scientific text with fine-tuned large language models

2022-12-10 · Alexander Dunn, John Dagdelen, Nicholas Walker, SangHoon Lee, Andrew S. Rosen, Gerbrand Ceder, Kristin Persson, Anubhav Jain

Intelligently extracting and linking complex scientific information from unstructured text is a challenging endeavor particularly for those inexperienced with natural language processing. Here, we present a simple sequence-to-sequence approach to joint named entity recognition and relation extraction for complex hierarchical information in scientific text. The approach leverages a pre-trained large language model (LLM), GPT-3, that is fine-tuned on approximately 500 pairs of prompts (inputs) and completions (outputs). Information is extracted either from single sentences or across sentences in abstracts/passages, and the output can be returned as simple English sentences or a more structured format, such as a list of JSON objects. We demonstrate that LLMs trained in this way are capable of accurately extracting useful records of complex scientific knowledge for three representative tasks in materials chemistry: linking dopants with their host materials, cataloging metal-organic frameworks, and general chemistry/phase/morphology/application information extraction. This approach represents a simple, accessible, and highly-flexible route to obtaining large databases of structured knowledge extracted from unstructured text. An online demo is available at http://www.matscholar.com/info-extraction.

📄 PDF Abstract BibTeX arXiv:2212.05238

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Modelnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Relation Extraction

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Residual Connection 설명 없음
15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Similar Papers 제목 키워드 기반

STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking

2025-07-04 · Tek Raj Chhetri, Yibei Chen, Puja Trivedi, Dorota Jarecka 외

The ability to extract structured information from unstructured sources-such as free-text documents and scientific literature-is critical for accelerating scientific discovery and knowledge synthesis. Large Language Mode…

BenchmarkingNavigatescientific discovery

SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documents

2024-10-28 · Qi Zhang, Zhijia Chen, Huitong Pan, Cornelia Caragea 외

Scientific information extraction (SciIE) is critical for converting unstructured knowledge from scholarly articles into structured data (entities and relations). Several datasets have been proposed for training and vali…

ArticlesRelationRelation ExtractionTAG

ByteScience: Bridging Unstructured Scientific Literature and Structured Data with Auto Fine-tuned Large Language Model in Token Granularity

2024-11-18 · Tong Xie, Hanzhi Zhang, Shaozhou Wang, Yuwei Wan 외

Natural Language Processing (NLP) is widely used to supply summarization ability from long context to structured information. However, extracting structured knowledge from scientific text by NLP models remains a challeng…

ArticlesLanguage ModelingLanguage ModellingLarge Language Model

Can AI Extract Antecedent Factors of Human Trust in AI? An Application of Information Extraction for Scientific Literature in Behavioural and Computer Sciences

2024-12-16 · Melanie McGrath, Harrison Bailey, Necva Bölücü, Xiang Dai 외

Information extraction from the scientific literature is one of the main techniques to transform unstructured knowledge hidden in the text into structured data which can then be used for decision-making in down-stream ta…

Decision MakingRelation Extraction

MatViX: Multimodal Information Extraction from Visually Rich Articles

2024-10-27 · Ghazal Khalighinejad, Sharon Scott, Ollie Liu, Kelly L. Anderson 외

Multimodal information extraction (MIE) is crucial for scientific literature, where valuable data is often spread across text, figures, and tables. In materials science, extracting structured information from research ar…

Articles