Why evaluate ontology technologies? because it works!

Staab, Steffen and Sure, York and Gómez-Pérez, A. and Daelemans, Walter and Reinberger, Marie-Laure and Guarino, Nicola and Noy, Natalya F. (2004). Why evaluate ontology technologies? because it works!. "IEEE Intelligent Systems", v. 19 (n. 4); pp. 74-81. ISSN 1941-1294. https://doi.org/10.1109/MIS.2004.37.


Title: Why evaluate ontology technologies? because it works!
  • Staab, Steffen
  • Sure, York
  • Gómez-Pérez, A.
  • Daelemans, Walter
  • Reinberger, Marie-Laure
  • Guarino, Nicola
  • Noy, Natalya F.
Item Type: Article
Título de Revista/Publicación: IEEE Intelligent Systems
Date: July 2004
ISSN: 1941-1294
Volume: 19
Faculty: Facultad de Informática (UPM)
Department: Inteligencia Artificial
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img] PDF - Users in campus UPM only - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (191kB)


Before we can give industry recommendations for incorporating ontology technology into its IT systems, we must consider two types of evaluation: content evaluation and ontology technology evaluation. Evaluating content is a must for preventing applications from using inconsistent, incorrect, or redundant ontologies. It’s unwise to publish an ontology that one or more software applications will use without first evaluating it. A well-evaluated ontology won’t guarantee the absence of problems, but it will make its use safer. Similarly, evaluating ontology technology will ease its integration with other software environments, ensuring a correct technology transfer from the academic to the industrial world. In this contribution, I explore both evaluation dimensions to try to answer the following questions: • How were widely used ontologies (including Cyc, WordNet and Euro WordNet, Standard Upper Ontology, and the DAML+OIL library) evaluated either during development or once they were implemented in an ontology language? • How robust are ontology evaluation methods? What type of ontology components do they evaluate? Are they independent of the language used to implement the ontologies? • How do ontology development platforms perform content evaluation? How mature are the evaluation tools incorporated on such platforms? Which types of errors do these tools detect? • What are the criteria used for evaluating ontology tools? What are the results?

Funding Projects

Government of SpainTIC2001-2745UnspecifiedUnspecifiedUnspecified

More information

Item ID: 72441
DC Identifier: https://oa.upm.es/72441/
OAI Identifier: oai:oa.upm.es:72441
DOI: 10.1109/MIS.2004.37
Official URL: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1333038
Deposited by: Biblioteca Facultad de Informatica
Deposited on: 25 Jan 2023 07:53
Last Modified: 25 Jan 2023 07:53
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM