Visual attention-aware omnidirectional video streaming using optimal tiles for virtual reality

Ozcinar, Cagri and Cabrera Quesada, Julian and Smolic, Aljosa (2019). Visual attention-aware omnidirectional video streaming using optimal tiles for virtual reality. "IEEE Journal on emerging and selected topics in circuits and systems", v. 9 (n. 1); pp. 217-230. ISSN 2156-3357. https://doi.org/10.1109/JETCAS.2019.2895096.

Description

Title: Visual attention-aware omnidirectional video streaming using optimal tiles for virtual reality
Author/s:
  • Ozcinar, Cagri
  • Cabrera Quesada, Julian
  • Smolic, Aljosa
Item Type: Article
Título de Revista/Publicación: IEEE Journal on emerging and selected topics in circuits and systems
Date: March 2019
ISSN: 2156-3357
Volume: 9
Subjects:
Freetext Keywords: Omnidirectional video; visual attention; tiles; adaptive streaming; virtual reality
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (6MB) | Preview

Abstract

Owing to its interactive look around nature and very large resolution requirement, providing immersive omnidirectional video (ODV) streaming experiences in virtual reality applications demands cost-effective solutions to meet both the content delivery network and device constraints. In this paper, we introduce an adaptive ODV streaming pipeline that optimizes dynamic adaptive streaming over HTTP representations of ODV content considering their visual attention (VA) maps. The main contribution of this paper is the use of VA maps: 1) to compute a novel objective quality metric that captures the fact that not all of the ODV is actually watched by users: the VA spherical weightedbased objective quality measurement; 2) to define optimal tile representations of the ODV frames, namely, tiling schemes, which are composed of variable-sized and non-overlapping tiles; and 3) to efficiently distribute a given bitrate budget among the set of tiles within a tiling scheme for an ODV. We evaluate the proposed system performance with varying bandwidth conditions and the tracked head orientations from user experiments. Results show that the proposed system significantly outperforms the existing non-tiled and tile-based streaming solutions.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainTEC2016-75981IVMEUnspecifiedUnspecified

More information

Item ID: 64250
DC Identifier: https://oa.upm.es/64250/
OAI Identifier: oai:oa.upm.es:64250
DOI: 10.1109/JETCAS.2019.2895096
Official URL: https://ieeexplore.ieee.org/document/8626197
Deposited by: Memoria Investigacion
Deposited on: 03 Mar 2021 15:58
Last Modified: 03 Mar 2021 15:58
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM