Q-Learning based control algorithm for HTTP adaptive streaming

Martín Gutiérrez, Virginia and Cabrera Quesada, Julian and García Santos, Narciso (2015). Q-Learning based control algorithm for HTTP adaptive streaming. In: "Visual Communications and Image Processing (VCIP 2015)", 13/12/2015 - 16/12/2015, Singapore. pp. 1-4. https://doi.org/10.1109/VCIP.2015.7457906.

Description

Title: Q-Learning based control algorithm for HTTP adaptive streaming
Author/s:
  • Martín Gutiérrez, Virginia
  • Cabrera Quesada, Julian
  • García Santos, Narciso
Item Type: Presentation at Congress or Conference (Article)
Event Title: Visual Communications and Image Processing (VCIP 2015)
Event Dates: 13/12/2015 - 16/12/2015
Event Location: Singapore
Title of Book: Visual Communications and Image Processing (VCIP 2015)
Date: 2015
Subjects:
Freetext Keywords: HTTP Adaptive Streaming, reinforcement learning, state, reward, policy, adaptation, Quality of Experience
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (836kB) | Preview

Abstract

We present a control algorithm based on Q-Learning for an HTTP Adaptive Streaming (HAS) Client in order to optimize the Quality of Experience (QoE) of the user. First, we propose a model with a suitable number of variables in an attempt to find a reasonable tradeoff between the complexity of the model and its capacity to capture appropriately the dynamics of the system. Second, we define a novel reward function that takes into consideration factors related to the user's QoE. Results will show, that our Q-learning algorithm is able to learn and efficiently control the selection of the segment qualities. In addition, we will show that our proposed approach outperforms another Q-learning approach.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainTEC2013-48453MR-UHDTVMinisterio de Economía y CompetitividadUnspecified
Government of SpainITEA2-11012ICAREMinisterio de Economía y CompetitividadUnspecified
Government of SpainIPT-2012-0306-430000VideocellsMinisterio de Economía y CompetitividadUnspecified

More information

Item ID: 42757
DC Identifier: http://oa.upm.es/42757/
OAI Identifier: oai:oa.upm.es:42757
DOI: 10.1109/VCIP.2015.7457906
Deposited by: Memoria Investigacion
Deposited on: 16 Jul 2016 09:46
Last Modified: 16 Jul 2016 09:46
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM