Does subject type influence software engineering experiment results?

Vegas Hernández, Sira and Riofrío Ojeda, Patricia and Juristo Juzgado, Natalia (2017). Does subject type influence software engineering experiment results?. In: "39th International Conference on Software Engineering Companion (ICSE-C 2017)", 20-28 May 2017, Buenos Aires, Argentina. ISBN 978-1-5386-1589-8. pp. 210-212. https://doi.org/10.1109/ICSE-C.2017.113.

Description

Title: Does subject type influence software engineering experiment results?
Author/s:
  • Vegas Hernández, Sira
  • Riofrío Ojeda, Patricia
  • Juristo Juzgado, Natalia
Item Type: Presentation at Congress or Conference (Article)
Event Title: 39th International Conference on Software Engineering Companion (ICSE-C 2017)
Event Dates: 20-28 May 2017
Event Location: Buenos Aires, Argentina
Title of Book: Proceedings of the 39th International Conference on Software Engineering (ICSE 2017)
Date: 2017
ISBN: 978-1-5386-1589-8
Subjects:
Freetext Keywords: Experimentation; Experiments with subjects; Experiments with professionals
Faculty: E.T.S. de Ingenieros Informáticos (UPM)
Department: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (122kB) | Preview

Abstract

A key issue when dealing with the generalization threat of software engineering experiments is to use different subject types. Objective: In this paper, we aim to investigate which subject types are used in experiments and their impact on results. Method: We have performed a systematic mapping study by manually searching experiments published from January 2014 to June 2016 in six leading software engineering conferences and journals. Results: Out of the 833 papers published in the period covered, we have identified 93 papers reporting experiments with subjects. Of these, 27 papers report experiments that have two subject types (professionals and students). We have studied the impact of subject type on the results of experiments reported in 11 of these papers. Conclusion: We have observed contradictory results. Only in some cases subject type influences experimental results. This suggests that further research is needed in order to find an explanation.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainTIN2014-60490-PUnspecifiedUniversidad Politécnica de MadridRealizando experimentos en la industria del software: comprensión del paso de laboratorio a la realidad

More information

Item ID: 50923
DC Identifier: http://oa.upm.es/50923/
OAI Identifier: oai:oa.upm.es:50923
DOI: 10.1109/ICSE-C.2017.113
Official URL: https://ieeexplore.ieee.org/abstract/document/7965306
Deposited by: Memoria Investigacion
Deposited on: 27 May 2019 11:15
Last Modified: 27 May 2019 11:15
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM