Evidence of the presence of bias in subjective metrics: analysis within a family of experiments

Aranda López King, Alejandrina; Juristo Juzgado, Natalia y Dieste Tubio, Oscar (2014). Evidence of the presence of bias in subjective metrics: analysis within a family of experiments. En: "18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014)", 13-14 May 2014, Londres, Reino Unido. ISBN 978-1-4503-2476-2. pp. 1-4.

Descripción

Título: Evidence of the presence of bias in subjective metrics: analysis within a family of experiments
Autor/es:
  • Aranda López King, Alejandrina
  • Juristo Juzgado, Natalia
  • Dieste Tubio, Oscar
Tipo de Documento: Ponencia en Congreso o Jornada (Otro)
Título del Evento: 18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014)
Fechas del Evento: 13-14 May 2014
Lugar del Evento: Londres, Reino Unido
Título del Libro: EASE '14: proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering
Fecha: 2014
ISBN: 978-1-4503-2476-2
Materias:
Palabras Clave Informales: Reliability; Validity; Objective and subjective measurements; Experiment; Quasi-experiment; Correlational study
Escuela: E.T.S. de Ingenieros Informáticos (UPM)
Departamento: Lenguajes y Sistemas Informáticos e Ingeniería del Software
Licencias Creative Commons: Reconocimiento - Sin obra derivada - No comercial

Texto completo

[img]
Vista Previa
PDF (Document Portable Format) - Se necesita un visor de ficheros PDF, como GSview, Xpdf o Adobe Acrobat Reader
Descargar (392kB) | Vista Previa

Resumen

Context: Measurement is crucial and important to empirical software engineering. Although reliability and validity are two important properties warranting consideration in measurement processes, they may be influenced by random or systematic error (bias) depending on which metric is used. Aim: Check whether, the simple subjective metrics used in empirical software engineering studies are prone to bias. Method: Comparison of the reliability of a family of empirical studies on requirements elicitation that explore the same phenomenon using different design types and objective and subjective metrics. Results: The objectively measured variables (experience and knowledge) tend to achieve more reliable results, whereas subjective metrics using Likert scales (expertise and familiarity) tend to be influenced by systematic error or bias. Conclusions: Studies that predominantly use variables measured subjectively, like opinion polls or expert opinion acquisition.

Proyectos asociados

TipoCódigoAcrónimoResponsableTítulo
Gobierno de EspañaTIN 2011-23216Sin especificarSin especificarSin especificar

Más información

ID de Registro: 37491
Identificador DC: http://oa.upm.es/37491/
Identificador OAI: oai:oa.upm.es:37491
URL Oficial: http://dl.acm.org/citation.cfm?id=2601291
Depositado por: Memoria Investigacion
Depositado el: 29 Sep 2015 11:02
Ultima Modificación: 14 Nov 2017 10:07
  • Open Access
  • Open Access
  • Sherpa-Romeo
    Compruebe si la revista anglosajona en la que ha publicado un artículo permite también su publicación en abierto.
  • Dulcinea
    Compruebe si la revista española en la que ha publicado un artículo permite también su publicación en abierto.
  • Recolecta
  • e-ciencia
  • Observatorio I+D+i UPM
  • OpenCourseWare UPM