Understanding replication of experiments in software engineering: a classification

Gómez Gómez, Omar Salvador; Juristo Juzgado, Natalia y Vegas Hernández, Sira (2014). Understanding replication of experiments in software engineering: a classification. "Information and Software Technology", v. 56 (n. 8); pp. 1033-1048. ISSN 0950-5849. https://doi.org/10.1016/j.infsof.2014.04.004.


Título: Understanding replication of experiments in software engineering: a classification
  • Gómez Gómez, Omar Salvador
  • Juristo Juzgado, Natalia
  • Vegas Hernández, Sira
Tipo de Documento: Artículo
Título de Revista/Publicación: Information and Software Technology
Fecha: 2014
Volumen: 56
Palabras Clave Informales: Software engineering; Experimental software engineering; Experimentation; Replication
Escuela: E.T.S. de Ingenieros Informáticos (UPM)
Departamento: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Licencias Creative Commons: Reconocimiento - Sin obra derivada - No comercial

Texto completo

Vista Previa
PDF (Document Portable Format) - Se necesita un visor de ficheros PDF, como GSview, Xpdf o Adobe Acrobat Reader
Descargar (1MB) | Vista Previa


Context: Replication plays an important role in experimental disciplines. There are still many uncertain- ties about how to proceed with replications of SE experiments. Should replicators reuse the baseline experiment materials? How much liaison should there be among the original and replicating experiment- ers, if any? What elements of the experimental configuration can be changed for the experiment to be considered a replication rather than a new experiment? Objective: To improve our understanding of SE experiment replication, in this work we propose a classi- fication which is intend to provide experimenters with guidance about what types of replication they can perform. Method: The research approach followed is structured according to the following activities: (1) a litera- ture review of experiment replication in SE and in other disciplines, (2) identification of typical elements that compose an experimental configuration, (3) identification of different replications purposes and (4) development of a classification of experiment replications for SE. Results: We propose a classification of replications which provides experimenters in SE with guidance about what changes can they make in a replication and, based on these, what verification purposes such a replication can serve. The proposed classification helped to accommodate opposing views within a broader framework, it is capable of accounting for less similar replications to more similar ones regarding the baseline experiment. Conclusion: The aim of replication is to verify results, but different types of replication serve special ver- ification purposes and afford different degrees of change. Each replication type helps to discover partic- ular experimental conditions that might influence the results. The proposed classification can be used to identify changes in a replication and, based on these, understand the level of verification.

Proyectos asociados

Gobierno de EspañaTIN 2011-23216Sin especificarSin especificarSin especificar

Más información

ID de Registro: 37429
Identificador DC: http://oa.upm.es/37429/
Identificador OAI: oai:oa.upm.es:37429
Identificador DOI: 10.1016/j.infsof.2014.04.004
URL Oficial: http://www.journals.elsevier.com/information-and-software-technology/
Depositado por: Memoria Investigacion
Depositado el: 10 Sep 2015 08:57
Ultima Modificación: 14 Nov 2017 10:10
  • GEO_UP4
  • Open Access
  • Open Access
  • Sherpa-Romeo
    Compruebe si la revista anglosajona en la que ha publicado un artículo permite también su publicación en abierto.
  • Dulcinea
    Compruebe si la revista española en la que ha publicado un artículo permite también su publicación en abierto.
  • Recolecta
  • InvestigaM
  • Observatorio I+D+i UPM
  • OpenCourseWare UPM