Adopting configuration management principles for managing experiment materials in families of experiments

Espinosa Gallardo, Edison Gonzalo and Acuña, Silvia T. and Vegas Hernández, Sira and Juristo Juzgado, Natalia (2019). Adopting configuration management principles for managing experiment materials in families of experiments. "Information and Software Technology", v. 113 ; pp. 39-67. ISSN 0950-5849. https://doi.org/10.1016/j.infsof.2019.05.003.

Description

Title: Adopting configuration management principles for managing experiment materials in families of experiments
Author/s:
  • Espinosa Gallardo, Edison Gonzalo
  • Acuña, Silvia T.
  • Vegas Hernández, Sira
  • Juristo Juzgado, Natalia
Item Type: Article
Título de Revista/Publicación: Information and Software Technology
Date: September 2019
ISSN: 0950-5849
Volume: 113
Subjects:
Freetext Keywords: Experimental software engineering; Experiment replication; Experimental material; Experimental software configuration management
Faculty: E.T.S. de Ingenieros Informáticos (UPM)
Department: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (790kB) | Preview

Abstract

Context. Replication is a key component of experimentation for verifying previous results and findings. Experiment replication requires products like documentation describing the baseline experiment and a version of the experimental material. When replicating an experiment, changes may have to be made to some of the products, leading to new or modified versions of materials. After the replication has been conducted, part of or all the materials should be added to the family history or to the baseline experiment documentation. As the number of replications increases, more versions of the materials are generated. This can lead to product management chaos in replications sharing the same protocol. Objective. The aim of this paper is to adopt configuration management principles to manage experimental materials. We apply and validate these principles in a code inspection technique comparison experimentand a personality quasi-experiment. Method. The study was conducted within a research group with lengthy experience in experiment replication. This research group has had trouble with the management of the materials used to run some of the experiments replicated by other colleagues. This is a suitable context for applying action research. We used action research to adopt the configuration management principles and build a materials management framework. Result. We generated the instances of an experiment and a quasi-experiment, identifying the status and traceability of the materials. Additionally, we documented the work load required for instantiation in person-hours. We also checked the ease of use and understanding of the framework for instantiating the personality quasi-experiment configuration plan executed by researchers who did not develop the framework, as well as its usefulness for managing the experimental materials. Conclusion. The experimental materials management framework is useful for establishing the status and traceability of the experimental materials. Additionally, it improves the storage, search, location and retrieval of the experimental material versions.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainPGC2018-097265-B-100UnspecifiedUnspecifiedUnspecified
Government of SpainRTI2018-095222-B-100MASSIVEUnspecifiedUnspecified
Madrid Regional GovernmentP2018/TCS-4314FORTE-CMUniversidad Autónoma de MadridFORmal models and technologies for emerging applications
Government of SpainTIN2014-52129-RUnspecifiedUniversidad Autónoma de MadridFlexible model-driven engineering for mobile, open, dynamic data systems
Government of SpainTIN2014-60490-PUnspecifiedUniversidad Politécnica de MadridRealizando experimentos en la industria del software: comprensión del paso de laboratorio a la realidad

More information

Item ID: 64044
DC Identifier: http://oa.upm.es/64044/
OAI Identifier: oai:oa.upm.es:64044
DOI: 10.1016/j.infsof.2019.05.003
Official URL: https://doi.org/10.1016/j.infsof.2019.05.003
Deposited by: Memoria Investigacion
Deposited on: 22 Oct 2020 10:38
Last Modified: 22 Oct 2020 10:38
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM