Skip to main content
SpringerLink
Log in

HTTP Extensions for the Management of Highly Dynamic Data Resources

  • Conference paper
  • First Online:
The Semantic Web (ESWC 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12731))

Included in the following conference series:

Abstract

As Semantic Web Technologies are increasingly employed for the management of highly dynamic data resources, e.g., the Industrial Internet of Things, resource versioning, state synchronization and distributed data management infrastructures are gaining practical relevance. The HTTP Memento protocol has recently been discussed as a promising building block for the implementation of such services for Findable, Accessible, Interoperable and Reusable (FAIR) Data. While this standard already enables the management and discovery of persistent, immutable and versioned resources on the Web and in Knowledge Graphs, it lacks support for the management of data updated at high frequencies and only provides inefficient means for managing resources with many revisions.

To address these shortcomings, we propose three extensions to the HTTP Memento protocol: arbitrary resolution timestamps, resource creation support and range requests for TimeMaps. We provide a reference implementation of our proposals as open source software and quantitatively evaluate the extensions’ performance, showcasing superior results in terms of resource capacity, insertion correctness, latency and amount of transferred data. Based on a qualitative analysis, we conclude that in conjunction with our proposed extensions, the HTTP Memento protocol addresses a variety of data management challenges including data archiving, citation, retrieval, discovery, synchronization and sustainability for highly dynamic data on the Web and in Knowledge Graphs, providing a promising foundation for prospective standardized and interoperable data management solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://git.rwth-aachen.de/i5/factdag/memento-server.

References

  1. Anderson, J.: RDF graph stores as convergent datatypes. In: MEPDaW@WWW, pp. 940–942 (2019)

    Google Scholar 

  2. Argos.io Pty Ltd.: JSON Time Series. https://docs.eagle.io/en/latest/reference/historic/jts.html

  3. Berners-Lee, T.: Socially aware cloud storage. Notes on web design, 17 August 2009

    Google Scholar 

  4. Braden, R.T.: Requirements for internet hosts - application and support. Technical report 1123, IETF, October 1989 https://rfc-editor.org/rfc/rfc1123.txt

  5. Calbimonte, J.P.: Linked data notifications for RDF streams. In: WSP/WOMoCoE@ISWC, pp. 66–73 (2017)

    Google Scholar 

  6. Dell’Aglio, D., Calbimonte, J.-P., Della Valle, E., Corcho, O.: Towards a unified language for RDF stream query processing. In: Gandon, F., Guéret, C., Villata, S., Breslin, J., Faron-Zucker, C., Zimmermann, A. (eds.) ESWC 2015. LNCS, vol. 9341, pp. 353–363. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25639-9_48

    Chapter  Google Scholar 

  7. Fielding, R., Lafon, Y., Reschke, J.: Hypertext transfer protocol (http/1.1): range requests. Technical report 7233, IETF, June 2014. http://www.rfc-editor.org/rfc/rfc7233.txt

  8. Gleim, L., Decker, S.: Open challenges for the management and preservation of evolving data on the web. In: MEPDaW@ISWC (2020)

    Google Scholar 

  9. Gleim, L., Decker, S.: Timestamped URLs as persistent identifiers. In: MEPDaW@ISWC (2020)

    Google Scholar 

  10. Gleim, L., Pennekamp, J., Liebenberg, M., Buchsbaum, M., et al.: FactDAG: formalizing data interoperability in an internet of production. IEEE IoT J. 7, 3243–3253 (2020)

    Google Scholar 

  11. Gleim, L., Pennekamp, J., Tirpitz, L., Welten, S., Brillowski, F., Decker, S.: FactStack: interoperable data management and preservation for the web and industry 4.0. In: Sattler, K.-U., Herschel, M., Lehner, W. (eds.) BTW 2021, pp. 371–395. Gesellschaft für Informatik, Bonn (2021). https://doi.org/10.18420/btw2021-20

  12. International Standardization Organization: ISO 8601: 2004 (E): Data Elements and Interchange Formats, Information Interchange. Representation of Dates and Times, ISO (2004)

    Google Scholar 

  13. Klyne, G., Newman, C.: Date and time on the internet: timestamps. Technical report 3339, IETF, July 2002. https://www.ietf.org/rfc/rfc3339.txt

  14. Kovatsch, M., Matsukura, R., Lagally, M., Kawaguchi, T., Toumura, K., Kajimoto, K.: Web of Things (WoT) Architecture. W3C Recommendation (2020)

    Google Scholar 

  15. Meinhardt, P., Knuth, M., Sack, H.: TailR: a platform for preserving history on the web of data. In: International Conference on Semantic Systems (2015)

    Google Scholar 

  16. Pelgrin, O., Galárraga, L.: Towards Fully-fledged Archiving for RDF Datasets (2020)

    Google Scholar 

  17. Pennekamp, J., Glebke, R., Henze, M., Meisen, T., Quix, C., et al.: Towards an infrastructure enabling the internet of production. In: IEEE ICPS, pp. 31–37 (2019)

    Google Scholar 

  18. Sambra, A.V., Mansour, E., Hawke, S., Zereba, M., et al.: Solid: a platform for decentralized social applications based on linked data. Technical report, MIT CSAIL & QCRI (2016)

    Google Scholar 

  19. Van de Sompel, H., Nelson, M., Sanderson, R.: HTTP Framework for Time-Based Access to Resource States – Memento. RFC 7089 (2013)

    Google Scholar 

  20. Van de Sompel, H., Nelson, M.L., Sanderson, R., Balakireva, L.L., Ainsworth, S., Shankar, H.: Memento: Time Travel for the Web. arXiv:0911.1112 (2009)

  21. Van de Sompel, H., Sanderson, R., et al.: Persistent identifiers for scholarly assets and the web: the need for an unambiguous mapping. Int. J. Digital Curation 9(1), 331–342 (2014)

    Article  Google Scholar 

  22. Speicher, S., Arwe, J., Malhotra, A.: Linked Data Platform 1.0. W3C Recommendation (2015)

    Google Scholar 

  23. Taelman, R., Vander Sande, M., Herwegen, J., Mannens, E., Verborgh, R.: Triple storage for random-access versioned querying of RDF archives. J. Web Semant. 54, 4–28 (2018)

    Article  Google Scholar 

  24. Vander Sande, M., Verborgh, R., et al.: Toward sustainable publishing and querying of distributed Linked Data archives. J. Documentation 74(1), 195–222 (2018)

    Article  Google Scholar 

  25. Verborgh, R.: Querying history with Linked Data (2016). https://ruben.verborgh.org/blog/2016/06/22/querying-history-with-linked-data/

  26. Whitehead, E.J.: WebDAV and DeltaV: collaborative authoring, versioning, and configuration management for the web. In: HYPERTEXT, pp. 259–260 (2001)

    Google Scholar 

  27. Wilkinson, M.D., et al.: The FAIR guiding principles for scientific data management and stewardship. Sci. Data 3(1) (2016). https://doi.org/10.1038/sdata.2016.18

Download references

Acknowledgments

Funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy – EXC-2023 Internet of Production – 390621612.

Author information

Authors and Affiliations

  1. Databases and Information Systems, RWTH Aachen University, Aachen, Germany

    Lars Gleim, Liam Tirpitz & Stefan Decker

  2. Fraunhofer FIT, Sankt Augustin, Germany

    Stefan Decker

Authors
  1. Lars Gleim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liam Tirpitz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stefan Decker
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Lars Gleim or Liam Tirpitz .

Editor information

Editors and Affiliations

  1. Ghent University, Ghent, Belgium

    Ruben Verborgh

  2. Aalborg University, Aalborg, Denmark

    Katja Hose

  3. University of Mannheim, Mannheim, Germany

    Heiko Paulheim

  4. ERCIM, Sophia Antipolis, France

    Pierre-Antoine Champin

  5. University of Siegen, Siegen, Germany

    Maria Maleshkova

  6. Universidad Politécnica de Madrid, Boadilla del Monte, Spain

    Oscar Corcho

  7. eBay Inc., San Jose, CA, USA

    Petar Ristoski

  8. FIZ Karlsruhe - Leibniz Institute for Information Infrastructure, Eggenstein-Leopoldshafen, Germany

    Mehwish Alam

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gleim, L., Tirpitz, L., Decker, S. (2021). HTTP Extensions for the Management of Highly Dynamic Data Resources. In: Verborgh, R., et al. The Semantic Web. ESWC 2021. Lecture Notes in Computer Science(), vol 12731. Springer, Cham. https://doi.org/10.1007/978-3-030-77385-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77385-4_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77384-7

  • Online ISBN: 978-3-030-77385-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation