A system for multimodal interaction with Kinect-enabled virtual windows

Bernardos Barbolla, Ana M., Marquínez Prado, Iñigo, Gómez Cordero, David, Besada Portas, Juan Alberto ORCID: https://orcid.org/0000-0002-4330-4050 and Casar Corredera, José Ramón ORCID: https://orcid.org/0000-0003-3851-9038 (2015). A system for multimodal interaction with Kinect-enabled virtual windows. In: "7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)", 10/06/2015 - 12/06/2015, Turin, Italy. pp. 42-46.

Description

Title: A system for multimodal interaction with Kinect-enabled virtual windows
Author/s:
  • Bernardos Barbolla, Ana M.
  • Marquínez Prado, Iñigo
  • Gómez Cordero, David
  • Besada Portas, Juan Alberto https://orcid.org/0000-0002-4330-4050
  • Casar Corredera, José Ramón https://orcid.org/0000-0003-3851-9038
Item Type: Presentation at Congress or Conference (Article)
Event Title: 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)
Event Dates: 10/06/2015 - 12/06/2015
Event Location: Turin, Italy
Title of Book: 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2015)
Date: 2015
Subjects:
Freetext Keywords: Multimodal interaction; virtual windows; deictic interaction; smart spaces; smart objects
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[thumbnail of INVE_MEM_2015_228039.pdf]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (2MB) | Preview

Abstract

Commercial off-the-shelf gaming devices (e.g. such as Kinect) are demonstrating to have a great potential beyond their initial service purpose. In particul ar, when integrated within the environment or as part of smart objects, peripheral COTS for gaming may facilitate the definition of novel interaction methods, particularly applicable to smart spaces service concepts. In this direction, this paper describes a system prototype that makes possible to deliver multimodal interaction with the media contents in a Virtual Window. Using a Kinect device, the Interactive Window itself adjusts the video clipping to the real time perspective of the user ? who can freely move within the sensor coverage are. On the clipped video, the user is able to select objects by pointing at meaningful image sections and to initiate actions related to them. Voice orders may also complete the interaction when necessary. Although implemented for smart spaces, the service concept can also be applied to learning, remote control processes or teleconference.

Funding Projects

Type
Code
Acronym
Leader
Title
Government of Spain
TEC2014-55146-R
Ministerio de Economía y Competitividad
Unspecified
Unspecified

More information

Item ID: 42392
DC Identifier: https://oa.upm.es/42392/
OAI Identifier: oai:oa.upm.es:42392
Official URL: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?...
Deposited by: Memoria Investigacion
Deposited on: 19 Jul 2016 18:00
Last Modified: 21 Mar 2023 17:11
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM