JATE 2.0: Java Automatic Term Extraction with Apache Solr
Automatic Term Extraction (ATE) or Recognition (ATR) is a fundamental processing step preceding many complex knowledge engineering tasks. However, few methods have been implemented as public tools and in particular, available as open-source freeware. Further, little effort is made to develop an adaptable and scalable framework that enables customization, development, and comparison of algorithms under a uniform environment. This paper introduces JATE 2.0, a complete remake of the free Java Automatic Term Extraction Toolkit (Zhang et al., 2008) delivering new features including: (1) highly modular, adaptable and scalable ATE thanks to integration with Apache Solr, the open source free-text indexing and search platform; (2) an extended collection of state-of-the-art algorithms. We carry out experiments on two well-known benchmarking datasets and compare the algorithms along the dimensions of effectiveness (precision) and efficiency (speed and memory consumption). To the best of our knowledge, this is by far the only free ATE library offering a flexible architecture and the most comprehensive collection of algorithms.
Code (1)
Tasks
BenchmarkingTerm ExtractionSimilar Papers 제목 키워드 기반
JaTeCS an open-source JAva TExt Categorization System
JaTeCS is an open source Java library that supports research on automatic text categorization and other related problems, such as ordinal regression and quantification, which are of special interest in opinion mining app…
feature selectionOpinion MiningText CategorizationAn Exploration of Approaches to Integrating Neural Reranking Models in Multi-Stage Ranking Architectures
We explore different approaches to integrating a simple convolutional neural network (CNN) with the Lucene search engine in a multi-stage ranking architecture. Our models are trained using the PyTorch deep learning toolk…
RerankingTribuo: Machine Learning with Provenance in Java
Machine Learning models are deployed across a wide range of industries, performing a wide range of tasks. Tracking these models and ensuring they behave appropriately is becoming increasingly difficult as the number of d…
Anomaly DetectionBIG-bench Machine LearningMulti-class ClassificationMulti-Label Classification+1Revisiting Distributional Correspondence Indexing: A Python Reimplementation and New Experiments
This paper introduces PyDCI, a new implementation of Distributional Correspondence Indexing (DCI) written in Python. DCI is a transfer learning method for cross-domain and cross-lingual text classification for which we h…
Domain AdaptationGeneral ClassificationSentiment Analysistext-classification+2tabulapdf: An R Package to Extract Tables from PDF Documents
tabulapdf is an R package that utilizes the Tabula Java library to import tables from PDF files directly into R. This tool can reduce time and effort in data extraction processes in fields like investigative journalism. …
RetrievalTable Extraction