About subjective evaluation of adaptive video streaming

Tavakoli, Samira and Brunnström, Kjell and García Santos, Narciso (2015). About subjective evaluation of adaptive video streaming. In: "Human Vision and Electronic Imaging XX", 09/02/2015 - 12/02/2015, San Francisco, California, EE.UU. pp. 1-11. https://doi.org/10.1117/12.2076387.


Title: About subjective evaluation of adaptive video streaming
  • Tavakoli, Samira
  • Brunnström, Kjell
  • García Santos, Narciso
Item Type: Presentation at Congress or Conference (Article)
Event Title: Human Vision and Electronic Imaging XX
Event Dates: 09/02/2015 - 12/02/2015
Event Location: San Francisco, California, EE.UU
Title of Book: SPIE Proceedings
Date: March 2015
Volume: 9394
Freetext Keywords: HTTP Adaptive Streaming, Perceptual Quality, Subjective Assessment, Audiovisual Quality
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img] PDF - Users in campus UPM only - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (2MB)


The usage of HTTP Adaptive Streaming (HAS) technology by content providers is increasing rapidly. Having available the video content in multiple qualities, using HAS allows to adapt the quality of downloaded video to the current network conditions providing smooth video-playback. However, the time-varying video quality by itself introduces a new type of impairment. The quality adaptation can be done in different ways. In order to find the best adaptation strategy maximizing users perceptual quality it is necessary to investigate about the subjective perception of adaptation-related impairments. However, the novelties of these impairments and their comparably long time duration make most of the standardized assessment methodologies fall less suited for studying HAS degradation. Furthermore, in traditional testing methodologies, the quality of the video in audiovisual services is often evaluated separated and not in the presence of audio. Nevertheless, the requirement of jointly evaluating the audio and the video within a subjective test is a relatively under-explored research field. In this work, we address the research question of determining the appropriate assessment methodology to evaluate the sequences with time-varying quality due to the adaptation. This was done by studying the influence of different adaptation related parameters through two different subjective experiments using a methodology developed to evaluate long test sequences. In order to study the impact of audio presence on quality assessment by the test subjects, one of the experiments was done in the presence of audio stimuli. The experimental results were subsequently compared with another experiment using the standardized single stimulus Absolute Category Rating (ACR) methodology.

Funding Projects

Government of SpainTEC2010-20412Enhanced 3DTVMinisterio de Economía y CompetitividadUnspecified
Government of SpainTEC2013-48453MR-UHDTVMinisterio de Economía y CompetitividadUnspecified

More information

Item ID: 42796
DC Identifier: https://oa.upm.es/42796/
OAI Identifier: oai:oa.upm.es:42796
DOI: 10.1117/12.2076387
Deposited by: Memoria Investigacion
Deposited on: 31 Jul 2016 10:53
Last Modified: 31 Jul 2016 10:53
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM