KorAP architecture – diving in the deep sea of corpus data
- KorAP is a corpus search and analysis platform, developed at the Institute for the German Language (IDS). It supports very large corpora with multiple annotation layers, multiple query languages, and complex licensing scenarios. KorAP’s design aims to be scalable, flexible, and sustainable to serve the German Reference Corpus DEREKO for at least the next decade. To meet these requirements, we have adopted a highly modular microservice-based architecture. This paper outlines our approach: An architecture consisting of small components that are easy to extend, replace, and maintain. The components include a search backend, a user and corpus license management system, and a web-based user frontend. We also describe a general corpus query protocol used by all microservices for internal communications. KorAP is open source, licensed under BSD-2, and available on GitHub.
Download full text files
Additional Services
Statistics
| Author: | Nils DiewaldGND, Michael Hanl, Eliza Margaretha, Joachim Bingel, Marc KupietzGND, Piotr BańskiGND, Andreas WittORCiDGND |
|---|---|
| URN: | urn:nbn:de:bsz:mh39-50361 |
| ISBN: | 978-2-9517408-9-1 |
| Parent Title (English): | Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Portorož, Slovenia |
| Publisher: | European Language Resources Association (ELRA) |
| Place of publication: | Paris |
| Editor: | Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis |
| Document Type: | Conference Proceeding |
| Language: | English |
| Year of first Publication: | 2016 |
| Date of Publication (online): | 2016/07/01 |
| Publicationstate: | Veröffentlichungsversion |
| Tag: | Institut für Deutsche Sprache <Mannheim>; Korpusanalyseplattform (KorAP); microservices Textlinguistik; large corpus data |
| GND Keyword: | Korpus <Linguistik> |
| First Page: | 3586 |
| Last Page: | 3591 |
| DDC classes: | 400 Sprache / 430 Deutsch |
| Open Access?: | ja |
| Leibniz-Classification: | Sprache, Linguistik |
| Linguistics-Classification: | Korpuslinguistik |
| Licence (English): |  Creative Commons - Attribution-NonCommercial 4.0 International |