[BibTeX] [RIS]
Evaluating Task Success in a Dialogue System for Indoor Navigation
Type of publication: Inproceedings
Citation: dethlefsetal:10-semdial
Booktitle: Aspects of Semantics and Pragmatics of Dialogue. SemDial 2010, 14th Workshop on the Semantics and Pragmatics of Dialogue
Year: 2010
Pages: 143-146
Publisher: Polish Society for Cognitive Science; Pozna;, Poland
Abstract: In this paper we address the assessment of dialogue systems for indoor wayfinding. Based on the PARADISE evaluation framework we propose and evaluate several task success metrics for such a pur- pose. According to correlation and multiple linear regression analyses, we found that task success metrics that penalise difficulty in wayfinding are more informative of system performance than a success/failure binary task success metric.
Userfields: pdfurl={http://www.semdial2010.amu.edu.pl/book_www.pdf}, project={I5-DiaSpace}, status={Reviewed},
Keywords: Poster paper
Authors Dethlefs, Nina
CuayƔhuitl, Heriberto
Richter, Kai-Florian
Andonova, Elena
Bateman, John
Editors L{}upkowski, Pawel{}
Purve, Matthew
  • http://www.semdial2010.amu.edu...