On correctness in RDF stream processor benchmarking

Dell’Aglio, Daniele and Calbimonte, Jean-Paul and Balduini, Marco and Corcho, Oscar and Della Valle, E. (2013). On correctness in RDF stream processor benchmarking. In: "ISWC 2013: 12th International Semantic Web Conference", 21-25 Oct 2013, Sydney, Australia. ISBN 978-3-642-41338-4. pp. 326-342. https://doi.org/10.1007/978-3-642-41338-4_21.


Title: On correctness in RDF stream processor benchmarking
  • Dell’Aglio, Daniele
  • Calbimonte, Jean-Paul
  • Balduini, Marco
  • Corcho, Oscar
  • Della Valle, E.
Item Type: Presentation at Congress or Conference (Article)
Event Title: ISWC 2013: 12th International Semantic Web Conference
Event Dates: 21-25 Oct 2013
Event Location: Sydney, Australia
Title of Book: The Semantic Web - ISWC 2013
Date: 2013
ISBN: 978-3-642-41338-4
Volume: 8218
Faculty: E.T.S. de Ingenieros Informáticos (UPM)
Department: Inteligencia Artificial
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (2MB)


Two complementary benchmarks have been proposed so far for the evaluation and continuous improvement of RDF stream processors: SRBench and LSBench. They put a special focus on different features of the evaluated systems, including coverage of the streaming extensions of SPARQL supported by each processor, query processing throughput, and an early analysis of query evaluation correctness, based on comparing the results obtained by different processors for a set of queries. However, none of them has analysed the operational semantics of these processors in order to assess the correctness of query evaluation results. In this paper, we propose a characterization of the operational semantics of RDF stream processors, adapting well-known models used in the stream processing engine community: CQL and SECRET. Through this formalization, we address correctness in RDF stream processor benchmarks, allowing to determine the multiple answers that systems should provide. Finally, we present CSRBench, an extension of SRBench to address query result correctness verification using an automatic method.

More information

Item ID: 26769
DC Identifier: http://oa.upm.es/26769/
OAI Identifier: oai:oa.upm.es:26769
DOI: 10.1007/978-3-642-41338-4_21
Official URL: http://www.planet-data.eu/sites/default/files/publications/82190321-on-correctness-in-rdf-stream-processor-benchmarking.pdf
Deposited by: Memoria Investigacion
Deposited on: 18 Jul 2014 10:28
Last Modified: 22 Sep 2014 11:42
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM