paper-with-me

홈 › Papers

NLP for Knowledge Discovery and Information Extraction from Energetics Corpora

2024-02-10 · Francis G. VanGessel, Efrem Perry, Salil Mohan, Oliver M. Barham, Mark Cavolowsky

We present a demonstration of the utility of NLP for aiding research into energetic materials and associated systems. The NLP method enables machine understanding of textual data, offering an automated route to knowledge discovery and information extraction from energetics text. We apply three established unsupervised NLP models: Latent Dirichlet Allocation, Word2Vec, and the Transformer to a large curated dataset of energetics-related scientific articles. We demonstrate that each NLP algorithm is capable of identifying energetic topics and concepts, generating a language model which aligns with Subject Matter Expert knowledge. Furthermore, we present a document classification pipeline for energetics text. Our classification pipeline achieves 59-76\% accuracy depending on the NLP model used, with the highest performing Transformer model rivaling inter-annotator agreement metrics. The NLP approaches studied in this work can identify concepts germane to energetics and therefore hold promise as a tool for accelerating energetics research efforts and energetics material development.

📄 PDF Abstract BibTeX arXiv:2402.06964

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesDocument ClassificationLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Assessing the trade-off between prediction accuracy and interpretability for topic modeling on energetic materials corpora

2022-06-01 · Monica Puerto, Mason Kellett, Rodanthi Nikopoulou, Mark D. Fuge 외

As the amount and variety of energetics research increases, machine aware topic identification is necessary to streamline future research pipelines. The makeup of an automatic topic identification process consists of cre…

Document EmbeddingPrediction

Dual Architecture for Name Entity Extraction and Relation Extraction with Applications in Medical Corpora

2021-10-16 · ACL ARR November 2021 11 · Anonymous

There is a growing interest in automatic knowledge discovery in plain text documents. Automation enables the analysis of massive collections of information. Such efforts are especially relevant in the health domain as ad…

RelationRelation Extraction

Unsupervised Term Extraction for Highly Technical Domains

2022-10-24 · Francesco Fusco, Peter Staar, Diego Antognini

Term extraction is an information extraction task at the root of knowledge discovery platforms. Developing term extractors that are able to generalize across very diverse and potentially highly technical domains is chall…

SentenceTerm Extraction

Equation discovery framework EPDE: Towards a better equation discovery

2024-12-28 · Mikhail Maslyaev, Alexander Hvatov

Equation discovery methods hold promise for extracting knowledge from physics-related data. However, existing approaches often require substantial prior information that significantly reduces the amount of knowledge extr…

Equation Discovery

Improving Company Valuations with Automated Knowledge Discovery, Extraction and Fusion

2020-10-19 · Albert Weichselbraun, Philipp Kuntschik, Sandro Hörler

Performing company valuations within the domain of biotechnology, pharmacy and medical technology is a challenging task, especially when considering the unique set of risks biotech start-ups face when entering new market…

Semantic Parsing