A multimodal interaction system for big displays

Bernardos Barbolla, Ana María and Muñoz Montalvo, Ana Isabel and Bergesio, Luca and Besada Portas, Juan Alberto and Casar Corredera, José Ramón (2017). A multimodal interaction system for big displays. In: "6th ACM International Symposium on Pervasive Displays (PerDis 2017)", 07/06/2017 - 09/06/2017, Lugano, Suiza. pp. 1-2.

Description

Title: A multimodal interaction system for big displays
Author/s:
  • Bernardos Barbolla, Ana María
  • Muñoz Montalvo, Ana Isabel
  • Bergesio, Luca
  • Besada Portas, Juan Alberto
  • Casar Corredera, José Ramón
Item Type: Presentation at Congress or Conference (Article)
Event Title: 6th ACM International Symposium on Pervasive Displays (PerDis 2017)
Event Dates: 07/06/2017 - 09/06/2017
Event Location: Lugano, Suiza
Title of Book: Proceedings of The 6th ACM International Symposium on Pervasive Displays (PerDis 2017)
Date: July 2017
Subjects:
Freetext Keywords: Big displays, ultrawalls, multimodal interaction, pointing system, speech interaction, natural interfaces, user experience.
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (256kB) | Preview

Abstract

Big displays and ultrawalls are increasingly present in nowadays environments (e.g. in city spaces, buildings, transportation means, teaching rooms, operation rooms, convention centers, etc.), at the same time that they are widely used as tools for collaborative work, monitoring and control in many other contexts. How to enhance interaction with big displays to make it more natural and fluent is still an open challenge. This paper presents a system for multimodal interaction based on pointing and speech recognition. The system makes possible for the user to control the big display through a combination of pointing gestures and a set of control commands built on a predefined vocabulary. The system is already prototyped and being used for service demonstrations for different applications.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainTEC2014-55146-RUnspecifiedUnspecifiedUnspecified
Universidad Politécnica de MadridUnspecifiedRP150955017UnspecifiedUnspecified

More information

Item ID: 50134
DC Identifier: http://oa.upm.es/50134/
OAI Identifier: oai:oa.upm.es:50134
Deposited by: Memoria Investigacion
Deposited on: 30 Apr 2018 16:31
Last Modified: 30 Apr 2018 16:31
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM