Experiments in SE: promises & perils

Juristo Juzgado, Natalia (2018). Experiments in SE: promises & perils. In: "11th International Conference on the Quality of Information and Communications Technology (QUATIC 2018)", 4-7 Sep 2018, Coimbra, Portugal. ISBN 9781538658420. pp. 1-51. https://doi.org/10.1109/QUATIC.2018.00009.

Description

Title: Experiments in SE: promises & perils
Author/s:
  • Juristo Juzgado, Natalia
Item Type: Presentation at Congress or Conference (Poster)
Event Title: 11th International Conference on the Quality of Information and Communications Technology (QUATIC 2018)
Event Dates: 4-7 Sep 2018
Event Location: Coimbra, Portugal
Title of Book: QUATIC 2018: 11th International Conference on the Quality of Information and Communications Technology
Date: 2018
ISBN: 9781538658420
Subjects:
Faculty: E.T.S. de Ingenieros Informáticos (UPM)
Department: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (142MB) | Preview

Abstract

This talk starts brushing up some basics on experiments: which are their hallmarks and strengths, and what makes them different from other types of empirical studies. Then I will go over some of the main challenges that experimentation is facing today in SE: • Methodological shortcomings. Several of the experiments being conducted (and published) today suffer weaknesses that need to be addressed in order to get reliable findings. Experimentation is a quite novel approach for the big majority of SE researchers so it should not be a surprise that our experiments are a bit weak still. But rise awareness on this is critical to improve. • Lack of replications and families of experiments. Still most of the experiments run are just one shot. However isolated experiments are not the mean to generate mature findings. Replicate the studies in order to increase results reliability and grouping them in families to allow the reveal of moderator variables is the way to go if we really want to make SE an experimental discipline • Industry experiments. Laboratory experiments are just the beginning, field experiments (clinical trials in medicine) increase findings external validity. Unfortunately, we advance slow towards such end. Software industry lacks several of the motivations that medical doctors have to conduct clinical experiments. Is it possible to follow such experimental model?

More information

Item ID: 55416
DC Identifier: http://oa.upm.es/55416/
OAI Identifier: oai:oa.upm.es:55416
DOI: 10.1109/QUATIC.2018.00009
Official URL: https://ieeexplore.ieee.org/document/8590162
Deposited by: Memoria Investigacion
Deposited on: 27 Jun 2019 07:42
Last Modified: 27 Jun 2019 07:42
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM