A system for multimodal interaction with Kinect-enabled virtual windows

Bernardos Barbolla, Ana M. and Marquínez Prado, Iñigo and Gómez Cordero, David and Besada Portas, Juan Alberto and Casar Corredera, Jose Ramon (2015). A system for multimodal interaction with Kinect-enabled virtual windows. In: "7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)", 10/06/2015 - 12/06/2015, Turin, Italy. pp. 42-46.

Description

Title: A system for multimodal interaction with Kinect-enabled virtual windows
Author/s:
  • Bernardos Barbolla, Ana M.
  • Marquínez Prado, Iñigo
  • Gómez Cordero, David
  • Besada Portas, Juan Alberto
  • Casar Corredera, Jose Ramon
Item Type: Presentation at Congress or Conference (Article)
Event Title: 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)
Event Dates: 10/06/2015 - 12/06/2015
Event Location: Turin, Italy
Title of Book: 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)
Date: 2015
Subjects:
Freetext Keywords: Multimodal interaction; virtual windows; deictic interaction; smart spaces; smart objects
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (2MB) | Preview

Abstract

Commercial off-the-shelf gaming devices (e.g. such as Kinect) are demonstrating to have a great potential beyond their initial service purpose. In particul ar, when integrated within the environment or as part of smart objects, peripheral COTS for gaming may facilitate the definition of novel interaction methods, particularly applicable to smart spaces service concepts. In this direction, this paper describes a system prototype that makes possible to deliver multimodal interaction with the media contents in a Virtual Window. Using a Kinect device, the Interactive Window itself adjusts the video clipping to the real time perspective of the user ? who can freely move within the sensor coverage are. On the clipped video, the user is able to select objects by pointing at meaningful image sections and to initiate actions related to them. Voice orders may also complete the interaction when necessary. Although implemented for smart spaces, the service concept can also be applied to learning, remote control processes or teleconference.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainTEC2014-55146-RMinisterio de Economía y CompetitividadUnspecifiedUnspecified

More information

Item ID: 42392
DC Identifier: http://oa.upm.es/42392/
OAI Identifier: oai:oa.upm.es:42392
Official URL: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?reload=true&arnumber=7325484
Deposited by: Memoria Investigacion
Deposited on: 19 Jul 2016 18:00
Last Modified: 19 Jul 2016 18:00
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM