Effectiveness for detecting faults within and outside the scope of testing techniques: an independent replication

Apa, Cecilia; Dieste Tubio, Oscar; Espinosa Gallardo, Edison Gonzalo y Fonseca Carrera, Efrain Rodrigo (2013). Effectiveness for detecting faults within and outside the scope of testing techniques: an independent replication. "Empirical Software Engineering", v. 19 (n. 2); pp. 378-417. ISSN 1382-3256. https://doi.org/10.1007/s10664-013-9267-7.

Descripción

Título: Effectiveness for detecting faults within and outside the scope of testing techniques: an independent replication
Autor/es:
  • Apa, Cecilia
  • Dieste Tubio, Oscar
  • Espinosa Gallardo, Edison Gonzalo
  • Fonseca Carrera, Efrain Rodrigo
Tipo de Documento: Artículo
Título de Revista/Publicación: Empirical Software Engineering
Fecha: 2013
Volumen: 19
Materias:
Palabras Clave Informales: Replication · Experiment · Unit testing ·Reporting guidelines
Escuela: Facultad de Informática (UPM) [antigua denominación]
Departamento: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Licencias Creative Commons: Reconocimiento - Sin obra derivada - No comercial

Texto completo

[img]
Vista Previa
PDF (Document Portable Format) - Se necesita un visor de ficheros PDF, como GSview, Xpdf o Adobe Acrobat Reader
Descargar (1MB)

Resumen

The verification and validation activity plays a fundamental role in improving software quality. Determining which the most effective techniques for carrying out this activity are has been an aspiration of experimental software engineering researchers for years. This paper reports a controlled experiment evaluating the effectiveness of two unit testing techniques (the functional testing technique known as equivalence partitioning (EP) and the control-flow structural testing technique known as branch testing (BT)). This experiment is a literal replication of Juristo et al. (2013).Both experiments serve the purpose of determining whether the effectiveness of BT and EP varies depending on whether or not the faults are visible for the technique (InScope or OutScope, respectively). We have used the materials, design and procedures of the original experiment, but in order to adapt the experiment to the context we have: (1) reduced the number of studied techniques from 3 to 2; (2) assigned subjects to experimental groups by means of stratified randomization to balance the influence of programming experience; (3) localized the experimental materials and (4) adapted the training duration. We ran the replication at the Escuela Politécnica del Ejército Sede Latacunga (ESPEL) as part of a software verification & validation course. The experimental subjects were 23 master?s degree students. EP is more effective than BT at detecting InScope faults. The session/program andgroup variables are found to have significant effects. BT is more effective than EP at detecting OutScope faults. The session/program and group variables have no effect in this case. The results of the replication and the original experiment are similar with respect to testing techniques. There are some inconsistencies with respect to the group factor. They can be explained by small sample effects. The results for the session/program factor are inconsistent for InScope faults.We believe that these differences are due to a combination of the fatigue effect and a technique x program interaction. Although we were able to reproduce the main effects, the changes to the design of the original experiment make it impossible to identify the causes of the discrepancies for sure. We believe that further replications closely resembling the original experiment should be conducted to improve our understanding of the phenomena under study.

Más información

ID de Registro: 26305
Identificador DC: http://oa.upm.es/26305/
Identificador OAI: oai:oa.upm.es:26305
Identificador DOI: 10.1007/s10664-013-9267-7
URL Oficial: http://link.springer.com/article/10.1007%2Fs10664-013-9267-7
Depositado por: Memoria Investigacion
Depositado el: 21 May 2014 09:24
Ultima Modificación: 17 Ene 2017 08:11
  • Open Access
  • Open Access
  • Sherpa-Romeo
    Compruebe si la revista anglosajona en la que ha publicado un artículo permite también su publicación en abierto.
  • Dulcinea
    Compruebe si la revista española en la que ha publicado un artículo permite también su publicación en abierto.
  • Recolecta
  • e-ciencia
  • Observatorio I+D+i UPM
  • OpenCourseWare UPM