Evaluation of a User-Adapted Spoken Language Dialogue System: Measuring the Relevance of the Contextual Information Sources

Lucas Cuesta, Juan Manuel and Fernández Martínez, Fernando and Dragos Rada, G. and Lebai Lutfi, Syaheerah Binti and Ferreiros López, Javier (2011). Evaluation of a User-Adapted Spoken Language Dialogue System: Measuring the Relevance of the Contextual Information Sources. In: "3rd International Conference on Agents and Artificial Intelligence (ICAART 2011)", 28/01/2011 - 30/01/2011, Roma, Italia. pp. 218-223.

Description

Title: Evaluation of a User-Adapted Spoken Language Dialogue System: Measuring the Relevance of the Contextual Information Sources
Author/s:
  • Lucas Cuesta, Juan Manuel
  • Fernández Martínez, Fernando
  • Dragos Rada, G.
  • Lebai Lutfi, Syaheerah Binti
  • Ferreiros López, Javier
Item Type: Presentation at Congress or Conference (Article)
Event Title: 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011)
Event Dates: 28/01/2011 - 30/01/2011
Event Location: Roma, Italia
Title of Book: Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011)
Date: 2011
Volume: 1
Subjects:
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Ingeniería Electrónica
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (574kB) | Preview

Abstract

We present an evaluation of a spoken language dialogue system with a module for the management of userrelated information, stored as user preferences and privileges. The flexibility of our dialogue management approach, based on Bayesian Networks (BN), together with a contextual information module, which performs different strategies for handling such information, allows us to include user information as a new level into the Context Manager hierarchy. We propose a set of objective and subjective metrics to measure the relevance of the different contextual information sources. The analysis of our evaluation scenarios shows that the relevance of the short-term information (i.e. the system status) remains pretty stable throughout the dialogue, whereas the dialogue history and the user profile (i.e. the middle-term and the long-term information, respectively) play a complementary role, evolving their usefulness as the dialogue evolves.

More information

Item ID: 12832
DC Identifier: http://oa.upm.es/12832/
OAI Identifier: oai:oa.upm.es:12832
Official URL: http://www.icaart.org/ICAART2011/
Deposited by: Memoria Investigacion
Deposited on: 13 Dec 2012 11:17
Last Modified: 21 Apr 2016 12:09
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM