A Workflow Manager for Complex NLP and Content Curation Pipelines
We present a workflow manager for the flexible creation and customisation of NLP processing pipelines. The workflow manager addresses challenges in interoperability across various different NLP tasks and hardware-based resource usage. Based on the four key principles of generality, flexibility, scalability and efficiency, we present the first version of the workflow manager by providing details on its custom definition language, explaining the communication components and the general system architecture and setup. We currently implement the system, which is grounded and motivated by real-world industry use cases in several innovation and transfer projects.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Workflow Manager for Complex NLP and Content Curation Workflows
We present a workflow manager for the flexible creation and customisation of NLP processing pipelines. The workflow manager addresses challenges in interoperability across various different NLP tasks and hardware-based r…
Developing and Orchestrating a Portfolio of Natural Legal Language Processing and Document Curation Services
We present a portfolio of natural legal language processing and document curation services currently under development in a collaborative European project. First, we give an overview of the project and the different use …
Orchestrating NLP Services for the Legal Domain
Legal technology is currently receiving a lot of attention from various angles. In this contribution we describe the main technical components of a system that is currently under development in the European innovation pr…
Compendium Manager: a tool for coordination of workflow management instances for bulk data processing in Python
Compendium Manager is a command-line tool written in Python to automate the provisioning, launch, and evaluation of bioinformatics pipelines. Although workflow management tools such as Snakemake and Nextflow enable users…
ManagementGlobal Intelligent Content: Active Curation of Language Resources using Linked Data
As language resources start to become available in linked data formats, it becomes relevant to consider how linked data interoperability can play a role in active language processing workflows as well as for more static …
Information RetrievalMachine TranslationTranslation