A numerical analysis of allocation strategies for the multi-armed bandit problem under delayed rewards conditions in digital campaign management

Martín Blanco, Miguel Carlos and Jiménez Martín, Antonio and Mateos Caballero, Alfonso (2019). A numerical analysis of allocation strategies for the multi-armed bandit problem under delayed rewards conditions in digital campaign management. "Neurocomputing", v. 363 ; pp. 99-113. ISSN 0925-2312. https://doi.org/10.1016/j.neucom.2019.06.052.

Description

Title: A numerical analysis of allocation strategies for the multi-armed bandit problem under delayed rewards conditions in digital campaign management
Author/s:
  • Martín Blanco, Miguel Carlos
  • Jiménez Martín, Antonio
  • Mateos Caballero, Alfonso
Item Type: Article
Título de Revista/Publicación: Neurocomputing
Date: 2019
ISSN: 0925-2312
Volume: 363
Subjects:
Freetext Keywords: Multi-armed bandit problem, Delayed reward, Numerical study, Digital campaign management
Faculty: E.T.S. de Ingenieros Informáticos (UPM)
Department: Inteligencia Artificial
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB) | Preview

Abstract

In this paper, we analyze the most representative allocation strategies to deal with the multi-armed bandit problem in a context with delayed rewards by means of a numerical study based on a discrete event simulation. The scenario that we address is a digital marketing content recommendation system, called campaign management, used by marketers to create specific digital content that can be issued or configured for viewing by certain population segments according to a series of business variables, user profile or behavior. Both batch mode and online update architectures are considered for feedback from the different contents displayed to users. The results show that possibilistic reward (PR) methods outperform other allocation strategies in this scenario with delayed rewards.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainMTM2014-56949-C3-2-RUnspecifiedUniversidad Politécnica de MadridApoyo a decisiones en análisis de riesgos. Seguridad Operacional Aérea
Government of SpainMTM2017-86875-C3-3-RUnspecifiedUniversidad Politécnica de MadridToma de decisiones multicriterio y modelos de interdependencia para la gestión de riesgos. Seguridad en ATM

More information

Item ID: 67028
DC Identifier: https://oa.upm.es/67028/
OAI Identifier: oai:oa.upm.es:67028
DOI: 10.1016/j.neucom.2019.06.052
Official URL: https://www.sciencedirect.com/science/article/pii/S0925231219309373
Deposited by: Memoria Investigacion
Deposited on: 13 May 2021 09:22
Last Modified: 13 May 2021 09:22
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM