Volltext-Downloads (blau) und Frontdoor-Views (grau)

Maximizing the potential of very large corpora: 50 years of big language data at IDS Mannheim

  • Very large corpora have been built and used at the IDS since its foundation in 1964. They have been made available on the Internet since the beginning of the 90’s to currently over 30,000 researchers worldwide. The Institute provides the largest archive of written German (Deutsches Referenzkorpus, DeReKe) which has recently been extended to 24 billion words. DeReKe has been managed and analysed by engines known as COSMAS and afterwards COSMAS II, which is currently being replaced by a new, scalable analysis platform called KorAP. KorAP makes it possible to manage and analyse texts that are accompanied by multiple, potentially conflicting, grammatical and structural annotation layers, and is able to handle resources that are distributed across different, and possibly geographically distant, storage systems. The majority of texts in DeReKe are not licensed for free redistribution, hence, the COSMAS and KorAP systems offer technical solutions to facilitate research on very large corpora that are not available (and not suitable) for download. For the new KorAP system, it is also planned to provide sandboxed environments to support non-remote-API access “near the data” through which users can run their own analysis programs.

Export metadata

Additional Services

Search Google Scholar


Author:Marc KupietzGND, Harald LüngenGND, Piotr BańskiGND, Cyril Belica
Parent Title (English):Proceedinigs of the LREC-2014-workshop challenges in the management of large corpora (CMLC2)
Place of publication:Reykjavik
Document Type:Part of a Book
Year of first Publication:2014
Date of Publication (online):2014/10/24
Tag:big data; scalability; very large corpora
GND Keyword:Deutsch; Korpus <Linguistik>; Textkorpus
First Page:1
Last Page:6
DDC classes:400 Sprache / 430 Deutsch
Open Access?:ja
Leibniz-Classification:Sprache, Linguistik
Licence (English):License LogoCreative Commons - Attribution-NonCommercial 4.0 International