Scalable Knowledge Graph Construction from Text Collections
We present a scalable, open-source platform that {``}distills{''} a potentially large text collection into a knowledge graph. Our platform takes documents stored in Apache Solr and scales out the Stanford CoreNLP toolkit via Apache Spark integration to extract mentions and relations that are then ingested into the Neo4j graph database. The raw knowledge graph is then enriched with facts extracted from an external knowledge graph. The complete product can be manipulated by various applications using Neo4j{'}s native Cypher query language: We present a subgraph-matching approach to align extracted relations with external facts and show that fact verification, locating textual support for asserted facts, detecting inconsistent and missing facts, and extracting distantly-supervised training data can all be performed within the same framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Fact Verificationgraph constructionSimilar Papers 제목 키워드 기반
Methods for Knowledge Graph Construction from Text Collections: Development and Applications
Virtually every sector of society is experiencing a dramatic growth in the volume of unstructured textual data that is generated and published, from news and social media online interactions, through open access scholarl…
Information ExtractionKnowledge GraphsCoarse-to-fine Knowledge Graph Domain Adaptation based on Distantly-supervised Iterative Training
Modern supervised learning neural network models require a large amount of manually labeled data, which makes the construction of domain-specific knowledge graphs time-consuming and labor-intensive. In parallel, although…
Domain AdaptationGRAPH DOMAIN ADAPTATIONKnowledge Graphsnamed-entity-recognition+3gBuilder: A Scalable Knowledge Graph Construction System for Unstructured Corpus
We design a user-friendly and scalable knowledge graph construction (KGC) system for extracting structured knowledge from the unstructured corpus. Different from existing KGC systems, gBuilder provides a flexible and use…
graph constructionSchedulingSPECTRA: Synthetic IR Test Collections with Relevance Oracles and Controlled Distractor Diagnostics
Scalable information retrieval testing needs corpora that are large enough to stress index construction, ranking latency, query routing, and evaluation tooling, yet human-judged test collections remain expensive and may …
Information RetrievalMIL-BERT: Classification of Arbitrarily Large Text with Performance and Explanatory Guarantees
Many text classification decisions are viable based on constituent excerpts alone. Taking inspiration from the field of multiple instance learning, we present an algorithm for training a neural network to classify text b…
Multiple Instance LearningText Classification