The 10 most recently published documents
Um das Thema Gendern oder geschlechtergerechte Sprache hat sich eine hitzige gesellschaftliche Debatte entwickelt. Seit Anfang des Jahres ist die Diskussion um geschlechtergerechte Sprache medial wieder besonders präsent. Anlass ist u.a. die Überarbeitung der Bedeutungsbeschreibungen im Duden online. Vor kurzem widmete sogar Der Spiegel dem Thema den Hefttitel und einen Leitartikel (vgl. Bohr et al. 2021). Allerdings erschöpft sich die Diskussion leicht in Pro- und Kontra-Positionen, dabei gibt es eine ganze Bandbreite von Aspekten rund um das Thema ‚geschlechtergerechte Sprache‘ zu betrachten, die eine differenziertere Diskussion ermöglichen können. Ziel dieses Beitrags ist es, einige dieser Aspekte knapp und möglichst verständlich in die Debatte einzubringen.
Making research data publicly available for evaluation or reuse is a fundamental part of good scientific practice. However, regulations such as copyright law can prevent this practice and thereby hamper scientific progress. In Germany, text-based research disciplines have for a long time been mostly unable to publish corpora made from material outside of the public domain, effectively excluding contemporary works. While there are approaches to obfuscate text material in a way that it is no longer covered by the original copyright, many use cases still require the raw textual context for evaluation or follow-up research. Recent changes in copyright now permit text and data mining on copyrighted works. However, questions regarding reusability and sharing of such corpora at a later time are still not answered to a satisfying degree. We propose a workflow that allows interested third parties to access customized excerpts of protected corpora in accordance with current German copyright law and the soon to be implemented guidelines of the Digital Single Market directive. Our prototype is a very lightweight web interface that builds on commonly used repository software and web standards.
In this paper, we present our experiences and decisions in dealing with challenges in developing, maintaining and operating online research software tools in the field of linguistics. In particular, we highlight reproducibility, dependability, and security as important aspects of quality management – taking into account the special circumstances in which research software
is usually created.
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
(2021)
Since the introduction of large language models in Natural Language Processing, large raw corpora have played a crucial role in Computational Linguistics. However, most of these large raw corpora are either available only for English or not available to the general public due to copyright issues. Nevertheless, there are some examples of freely available multilingual corpora for training Deep Learning NLP models, such as the OSCAR and Paracrawl corpora. However, they have quality issues, especially for low-resource languages. Moreover, recreating or updating these corpora is very complex. In this work, we try to reproduce and improve the goclassy pipeline used to create the OSCAR corpus. We propose a new pipeline that is faster, modular, parameterizable, and well documented. We use it to create a corpus similar to OSCAR but larger and based on recent data. Also, unlike OSCAR, the metadata information is at the document level. We release our pipeline under an open source license and publish the corpus under a research-only license.