VES: A mixed-reality system to assist multisensory spatial perception and cognition for blind and visually impaired people

Real Valdés, Santiago Isidro and Araujo Pinto, Álvaro (2020). VES: A mixed-reality system to assist multisensory spatial perception and cognition for blind and visually impaired people. "Applied Sciences-Basel", v. 10 (n. 523); pp. 1-14. ISSN 2076-3417. https://doi.org/10.3390/app10020523.

Description

Title: VES: A mixed-reality system to assist multisensory spatial perception and cognition for blind and visually impaired people
Author/s:
  • Real Valdés, Santiago Isidro
  • Araujo Pinto, Álvaro
Item Type: Article
Título de Revista/Publicación: Applied Sciences-Basel
Date: January 2020
ISSN: 2076-3417
Volume: 10
Subjects:
Freetext Keywords: mixed reality; assistive technology; visually impaired; perception assistance; cognition assistance; sensory substitution
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Ingeniería Electrónica
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (5MB) | Preview

Abstract

In this paper, the Virtually Enhanced Senses (VES) System is described. It is an ARCore-based, mixed-reality system meant to assist blind and visually impaired people's navigation. VES operates in indoor and outdoor environments without any previous in-situ installation. It provides users with specific, runtime-configurable stimuli according to their pose, i.e., position and orientation, and the information of the environment recorded in a virtual replica. It implements three output data modalities: wall-tracking assistance, acoustic compass, and a novel sensory substitution algorithm, Geometry-based Virtual Acoustic Space (GbVAS). The multimodal output of this algorithm takes advantage of natural human perception encoding of spatial data. Preliminary experiments of GbVAS have been conducted with sixteen subjects in three different scenarios, demonstrating basic orientation and mobility skills after six minutes training.

More information

Item ID: 58146
DC Identifier: http://oa.upm.es/58146/
OAI Identifier: oai:oa.upm.es:58146
DOI: 10.3390/app10020523
Official URL: https://www.mdpi.com/2076-3417/10/2/523
Deposited by: Memoria Investigacion
Deposited on: 02 Mar 2020 16:25
Last Modified: 02 Mar 2020 16:25
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM