Exploratory Analysis of Highly Heterogeneous Document Collections
We present an effective multifaceted system for exploratory analysis of highly heterogeneous document collections. Our system is based on intelligently tagging individual documents in a purely automated fashion and exploiting these tags in a powerful faceted browsing framework. Tagging strategies employed include both unsupervised and supervised approaches based on machine learning and natural language processing. As one of our key tagging strategies, we introduce the KERA algorithm (Keyword Extraction for Reports and Articles). KERA extracts topic-representative terms from individual documents in a purely unsupervised fashion and is revealed to be significantly more effective than state-of-the-art methods. Finally, we evaluate our system in its ability to help users locate documents pertaining to military critical technologies buried deep in a large heterogeneous sea of information.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesKeyword ExtractionSimilar Papers 제목 키워드 기반
Term-Centric Hierarchy Induction from Heterogeneous Corpora
Organizing knowledge from diverse text sources into interpretable hierarchies is crucial for tasks such as policy analysis, innovation monitoring, and exploratory domain mapping. Existing taxonomy induction methods typic…
Term ExtractionAbstractive Summarization of Large Document Collections Using GPT
This paper proposes a method of abstractive summarization designed to scale to document collections instead of individual documents. Our approach applies a combination of semantic clustering, document size reduction with…
Abstractive Text SummarizationChunkingDocument SummarizationSiren Federate: Bridging document, relational, and graph models for exploratory graph analysis
Investigative workflows require interactive exploratory analysis on large heterogeneous knowledge graphs. Current databases show limitations in enabling such task. This paper discusses the architecture of Siren Federate,…
Knowledge GraphsSemantic Matching of Documents from Heterogeneous Collections: A Simple and Transparent Method for Practical Applications
We present a very simple, unsupervised method for the pairwise matching of documents from heterogeneous collections. We demonstrate our method with the Concept-Project matching task, which is a binary classification task…
Binary ClassificationGeneral ClassificationSemantic Matching of Documents from Heterogeneous Collections: A Simple and Transparent Method for Practical Applications
We present a very simple, unsupervised method for the pairwise matching of documents from heterogeneous collections. We demonstrate our method with the Concept-Project matching task, which is a binary classification task…
Binary Classification