TY  - CHAP
U1  - Konferenzveröffentlichung
A1  - Fankhauser, Peter
A1  - Do, Bich-Ngoc
A1  - Kupietz, Marc
ED  - Bański, Piotr
ED  - Barbaresi, Adrien
ED  - Clematide, Simon
ED  - Kupietz, Marc
ED  - Lüngen, Harald
ED  - Pisetta, Ines
T1  - Evaluating a Dependency Parser on DeReKo
T2  - Proceedings of the LREC 2020 Workshop, Language Resources and Evaluation Conference, 11–16 May 2020, 8th Workshop on Challenges in the Management of Large Corpora (CMLC-8)
N2  - We evaluate a graph-based dependency parser on DeReKo, a large corpus of contemporary German. The dependency parser is trained on the German dataset from the SPMRL 2014 Shared Task which contains text from the news domain, whereas DeReKo also covers other domains including fiction, science, and technology. To avoid the need for costly manual annotation of the corpus, we use the parser’s probability estimates for unlabeled and labeled attachment as main evaluation criterion. We show that these probability estimates are highly correlated with the actual attachment scores on a manually annotated test set. On this basis, we compare estimated parsing scores for the individual domains in DeReKo, and show that the scores decrease with increasing distance of a domain to the training corpus.
KW  - Korpus <Linguistik>
KW  - Dependency Parsing
KW  - Large Corpora
KW  - Parser
KW  - Evaluation
KW  - Zuverlässigkeit
KW  - Computerlinguistik
Y1  - 2020
U6  - https://nbn-resolving.org/urn:nbn:de:bsz:mh39-98138
UN  - https://nbn-resolving.org/urn:nbn:de:bsz:mh39-98138
UR  - http://corpora.ids-mannheim.de/cmlc-2020.html
SN  - 979-10-95546-61-0
SB  - 979-10-95546-61-0
SP  - 10
EP  - 14
PB  - European Language Resources Association
CY  - Paris
ER  -