A CUP of CoFee: A Large Collection of Feedback Utterances Provided with Communicative Function Annotations
- There have been several attempts to annotate communicative functions to utterances of verbal feedback in English previously. Here, we suggest an annotation scheme for verbal and non-verbal feedback utterances in French including the categories base, attitude, previous and visual. The data comprises conversations, maptasks and negotiations from which we extracted ca. 13,000 candidate feedback utterances and gestures. 12 students were recruited for the annotation campaign of ca. 9,500 instances. Each instance was annotated by between 2 and 7 raters. The evaluation of the annotation agreement resulted in an average best-pair kappa of 0.6. While the base category with the values acknowledgement, evaluation, answer, elicit and other achieves good agreement, this is not the case for the other main categories. The data sets, which also include automatic extractions of lexical, positional and acoustic features, are freely available and will further be used for machine learning classification experiments to analyse the form-function relationship of feedback.
Author: | Laurent Prévot, Jan GorischORCiDGND, Roxane Bertrand |
---|---|
URN: | urn:nbn:de:bsz:mh39-50414 |
ISBN: | 978-2-9517408-9-1 |
Parent Title (English): | Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Portorož, Slovenia |
Publisher: | European Language Resources Association (ELRA) |
Place of publication: | Paris |
Editor: | Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis |
Document Type: | Conference Proceeding |
Language: | English |
Year of first Publication: | 2016 |
Date of Publication (online): | 2016/07/05 |
Publicationstate: | Veröffentlichungsversion |
Tag: | Annotator Agreement; Communicative Functions; Conversational Feedback |
GND Keyword: | Annotation; Automatische Sprachanalyse; Gesprochene Sprache; Pragmatik; Rückmeldung |
First Page: | 3180 |
Last Page: | 3185 |
DDC classes: | 400 Sprache / 410 Linguistik |
Open Access?: | ja |
Leibniz-Classification: | Sprache, Linguistik |
Linguistics-Classification: | Korpuslinguistik |
Linguistics-Classification: | Pragmalinguistik / Kommunikationsforschung |
Licence (English): | Creative Commons - Attribution-NonCommercial 4.0 International |