TY - CHAP U1 - Buchbeitrag A1 - Kupietz, Marc A1 - Lüngen, Harald A1 - Bański, Piotr A1 - Belica, Cyril T1 - Maximizing the potential of very large corpora: 50 years of big language data at IDS Mannheim T2 - Proceedinigs of the LREC-2014-workshop challenges in the management of large corpora (CMLC2) N2 - Very large corpora have been built and used at the IDS since its foundation in 1964. They have been made available on the Internet since the beginning of the 90’s to currently over 30,000 researchers worldwide. The Institute provides the largest archive of written German (Deutsches Referenzkorpus, DeReKe) which has recently been extended to 24 billion words. DeReKe has been managed and analysed by engines known as COSMAS and afterwards COSMAS II, which is currently being replaced by a new, scalable analysis platform called KorAP. KorAP makes it possible to manage and analyse texts that are accompanied by multiple, potentially conflicting, grammatical and structural annotation layers, and is able to handle resources that are distributed across different, and possibly geographically distant, storage systems. The majority of texts in DeReKe are not licensed for free redistribution, hence, the COSMAS and KorAP systems offer technical solutions to facilitate research on very large corpora that are not available (and not suitable) for download. For the new KorAP system, it is also planned to provide sandboxed environments to support non-remote-API access “near the data” through which users can run their own analysis programs. KW - Deutsch KW - Korpus KW - Textkorpus KW - very large corpora KW - scalability KW - big data Y1 - 2014 U6 - https://nbn-resolving.org/urn:nbn:de:bsz:mh39-31634 UN - https://nbn-resolving.org/urn:nbn:de:bsz:mh39-31634 UR - http://www.lrec-conf.org/proceedings/lrec2014/workshops/LREC2014Workshop-CMLC2%20Proceedings-rev2.pdf SP - 1 EP - 6 PB - ELRA CY - Reykjavik ER -