Skip to main content
SpringerLink
Log in

BeSEPPI: Semantic-Based Benchmarking of Property Path Implementations

  • Conference paper
  • First Online:
The Semantic Web (ESWC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11503))

Included in the following conference series:

Abstract

In 2013 property paths were introduced with the release of SPARQL 1.1. These property paths allow for describing complex queries in a more concise and comprehensive way. The W3C introduced a formal specification of the semantics of property paths, to which implementations should adhere. Most commonly used RDF stores claim to support property paths. In order to give insight into how well current implementations of property paths work we have developed BeSEPPI, a benchmark for the semantic-based evaluation of property path implementations. BeSEPPI checks whether RDF stores follow the W3Cs semantics by testing the correctness and completeness of query result sets. The results of our benchmark show that only one out of 5 benchmarked RDF stores returns complete and correct result sets for all benchmark queries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    We have presented some preliminary results in a non-archival workshop contribution in [11]. For this paper, we have improved the benchmark by creating a larger variety of queries as well as their correct results sets. These queries are a unit test to check whether property paths implementations adhere to the W3C’s semantics.

  2. 2.

    With our definition of paths, we do not allow cycles to appear within a path. We use this definition since the auxiliary function ALP which is used by the transitive and transitive reflexive property path expression in the W3Cs semantics of property paths [9] uses the same definition of paths.

  3. 3.

    The notation of property path semantics presented in this section, is based on the definitions of property paths in [12].

  4. 4.

    In [12] the evaluation of the existential property path expression and the transitive reflexive closure property path expression are defined slightly differently from the definition of the W3C in [9]. We have contacted members of the SPARQL working group in order to resolve these differences [4, 5].

  5. 5.

    Available as open source under https://github.com/Institute-Web-Science-and-Technologies/BeSEPPI.

  6. 6.

    https:/www.blazegraph.com/.

  7. 7.

    https://franz.com/agraph/downloads.lhtml.

  8. 8.

    http://vos.openlinksw.com/owiki/wiki/VOS.

  9. 9.

    http://rdf4j.org/.

  10. 10.

    https://jena.apache.org/documentation/fuseki2/.

References

  1. Arenas, M., Pérez, J.: Federation and navigation in SPARQL 1.1. In: Eiter, T., Krennwallner, T. (eds.) Reasoning Web 2012. LNCS, vol. 7487, pp. 78–111. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33158-9_3

    Chapter  Google Scholar 

  2. Bizer, C., Schultz, A.: The Berlin SPARQL benchmark. Int. J. Semant. Web Inf. Syst. 5, 1–24 (2009)

    Google Scholar 

  3. https://www.w3.org/2001/sw/DataAccess/rq23/sparql-defns.html#defn_ASK

  4. https://lists.w3.org/Archives/Public/public-sparql-dev/2017OctDec/0009.html

  5. https://lists.w3.org/Archives/Public/public-sparql-dev/2018JanMar/0004.html

  6. DuCharme, B.: Learning SPARQL. O’Reilly Media Inc., Sebastopol (2011). Chap. 2, pp 19–44; Chap. 3. pp 45–100

    Google Scholar 

  7. Gubichev, A., Bedathur, S., Seufert, S.: Sparqling kleene: fast property paths in RDF-3X, June 2013

    Google Scholar 

  8. Guo, Y., Pan, Z., Heflin, J.: LUBM: A benchmark for OWL knowledge base systems. Web Semant. 3(2–3), 158–182 (2005). https://doi.org/10.1016/j.websem.2005.06.005

    Article  Google Scholar 

  9. Harris, S., Seaborne, A.: SPARQL 1.1 query language. https://www.w3.org/TR/sparql11-query/

  10. Hoffart, J., Suchanek, F.M., Berberich, K., Weikum, G.: YAGO2: a spatially and temporally enhanced knowledge base from Wikipedia. Artif. Intell. 194, 28–61 (2013). https://doi.org/10.1016/j.artint.2012.06.001. http://www.sciencedirect.com/science/article/pii/S0004370212000719. artificial Intelligence, Wikipedia and Semi-Structured Resources

    Article  MathSciNet  MATH  Google Scholar 

  11. Janke, D., Skubella, A., Staab, S.: Evaluating SPARQL 1.1 property path support. In: BLINK/NLIWoD3@ISWC (2017)

    Google Scholar 

  12. Kostylev, E.V., Reutter, J.L., Romero, M., Vrgoč, D.: SPARQL with property paths. In: Arenas, M., Corcho, O., Simperl, E., Strohmaier, M., d’Aquin, M., Srinivas, K., Groth, P., Dumontier, M., Heflin, J., Thirunarayan, K., Staab, S. (eds.) ISWC 2015. LNCS, vol. 9366, pp. 3–18. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25007-6_1

    Chapter  Google Scholar 

  13. Malyshev, S., Krötzsch, M., González, L., Gonsior, J., Bielefeldt, A.: Getting the most out of Wikidata: semantic technology usage in Wikipedia’s knowledge graph. In: Vrandečić, D., Bontcheva, K., Suárez-Figueroa, M.C., Presutti, V., Celino, I., Sabou, M., Kaffee, L.-A., Simperl, E. (eds.) ISWC 2018. LNCS, vol. 11137, pp. 376–394. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00668-6_23

    Chapter  Google Scholar 

  14. Morsey, M., Lehmann, J., Auer, S., Ngonga Ngomo, A.-C.: DBpedia SPARQL benchmark – performance assessment with real queries on real data. In: Aroyo, L., Welty, C., Alani, H., Taylor, J., Bernstein, A., Kagal, L., Noy, N., Blomqvist, E. (eds.) ISWC 2011. LNCS, vol. 7031, pp. 454–469. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25073-6_29. http://dl.acm.org/citation.cfm?id=2063016.2063046

    Chapter  Google Scholar 

  15. Prud’hommeaux, E., Seaborne, A.: SPARQL query language for RDF W3C recommendation (2008). https://www.w3.org/TR/rdf-sparql-query/#ask

  16. Cyganiak, R., Wood, D.,Lanthaler, M.: RDf 1.1 concepts and abstract syntax. Technical report, W3C Recommendation (2014)

    Google Scholar 

  17. Skubella, A., Janke, D., Staab, S.: BeSEPPI: semantic-based benchmarking of property path implementations technical report. Technical report, Institute for Web Science and Technologies (2019)

    Google Scholar 

  18. Thost, V., Dolby, J.: QED: out-of-the-box datasets for SPARQL query evaluation. In: Proceedings of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, USA, 8th–12th October 2018. (2018). http://ceur-ws.org/Vol-2180/paper-69.pdf

  19. Zhang, Y., Duc, P.M., Corcho, O., Calbimonte, J.-P.: SRBench: a streaming RDF/SPARQL benchmark. In: Cudré-Mauroux, P., Heflin, J., Sirin, E., Tudorache, T., Euzenat, J., Hauswirth, M., Parreira, J.X., Hendler, J., Schreiber, G., Bernstein, A., Blomqvist, E. (eds.) ISWC 2012. LNCS, vol. 7649, pp. 641–657. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-35176-1_40

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Web Science and Technologies, Universität Koblenz-Landau, Koblenz, Germany

    Adrian Skubella, Daniel Janke & Steffen Staab

  2. Web and Internet Science Group, University of Southampton, Southampton, UK

    Steffen Staab

Authors
  1. Adrian Skubella
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel Janke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Steffen Staab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adrian Skubella .

Editor information

Editors and Affiliations

  1. Wright State University, Dayton, OH, USA

    Pascal Hitzler

  2. KMi, The Open University, Milton Keynes, UK

    Miriam Fernández

  3. University of California, Santa Barbara, CA, USA

    Krzysztof Janowicz

  4. Maastricht University, Maastricht, The Netherlands

    Amrapali Zaveri

  5. Heriot-Watt University, Edinburgh, UK

    Alasdair J.G. Gray

  6. IBM Research, Dublin, Ireland

    Vanessa Lopez

  7. The Australian National University, Canberra, ACT, Australia

    Armin Haller

  8. Jönköping University, Jönköping, Sweden

    Karl Hammar

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Skubella, A., Janke, D., Staab, S. (2019). BeSEPPI: Semantic-Based Benchmarking of Property Path Implementations. In: Hitzler, P., et al. The Semantic Web. ESWC 2019. Lecture Notes in Computer Science(), vol 11503. Springer, Cham. https://doi.org/10.1007/978-3-030-21348-0_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-21348-0_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-21347-3

  • Online ISBN: 978-3-030-21348-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation