KorAP Architecture ― Diving in the Deep Sea of Corpus Data
KorAP is a corpus search and analysis platform, developed at the Institute for the German Language (IDS). It supports very large corpora with multiple annotation layers, multiple query languages, and complex licensing scenarios. KorAP{'}s design aims to be scalable, flexible, and sustainable to serve the German Reference Corpus DeReKo for at least the next decade. To meet these requirements, we have adopted a highly modular microservice-based architecture. This paper outlines our approach: An architecture consisting of small components that are easy to extend, replace, and maintain. The components include a search backend, a user and corpus license management system, and a web-based user frontend. We also describe a general corpus query protocol used by all microservices for internal communications. KorAP is open source, licensed under BSD-2, and available on GitHub.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementSimilar Papers 제목 키워드 기반
RKorAPClient: An R Package for Accessing the German Reference Corpus DeReKo via KorAP
Making corpora accessible and usable for linguistic research is a huge challenge in view of (too) big data, legal issues and a rapidly evolving methodology. This does not only affect the design of user-friendly graphical…
Access control by query rewriting: the case of KorAP
We present an approach to an aspect of managing complex access scenarios to large and heterogeneous corpora that involves handling user queries that, intentionally or due to the complexity of the queried resource, target…
The New IDS Corpus Analysis Platform: Challenges and Prospects
The present article describes the first stage of the KorAP project, launched recently at the Institut f{\"u}r Deutsche Sprache (IDS) in Mannheim, Germany. The aim of this project is to develop an innovative corpus analys…
Attentive Spatio-Temporal Representation Learning for Diving Classification
Competitive diving is a well recognized aquatic sport in which a person dives from a platform or a springboard into the water. Based on the acrobatics performed during the dive, diving is classified into a finite set of …
ClassificationGeneral ClassificationRepresentation LearningDiving Deep into Context-Aware Neural Machine Translation
Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although t…
Machine TranslationNMTTranslation