title: A unified framework for linear function approximation of value functions in stochastic control
creator: Sánchez Fernández, Matilde
creator: Valcarcel Macua, Sergio
creator: Zazo Bello, Santiago
subject: Telecommunications
description: This paper contributes with a unified formulation that merges previ- ous analysis on the prediction of the performance ( value function ) of certain sequence of actions ( policy ) when an agent operates a Markov decision process with large state-space. When the states are represented by features and the value function is linearly approxi- mated, our analysis reveals a new relationship between two common cost functions used to obtain the optimal approximation. In addition, this analysis allows us to propose an efficient adaptive algorithm that provides an unbiased linear estimate. The performance of the pro- posed algorithm is illustrated by simulation, showing competitive results when compared with the state-of-the-art solutions.
publisher: E.T.S.I. Telecomunicación (UPM)
rights: http://creativecommons.org/licenses/by-nc-nd/3.0/es/
date: 2013
type: info:eu-repo/semantics/conferenceObject
type: Presentation at Congress or Conference
source: 21st European Signal Processing Conference (EUSIPCO) | 21st European Signal Processing Conference (EUSIPCO) | 09/09/2013 - 13/09/2013 | Marrakech, Morocco
type: PeerReviewed
format: application/pdf
language: eng
relation: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6811729&tag=1
rights: info:eu-repo/semantics/openAccess
identifier: http://oa.upm.es/28942/