Skip to main content
SpringerLink
Log in

Sharing Linked Open Data over Peer-to-Peer Distributed File Systems: The Case of IPFS

  • Conference paper
  • First Online:
Book cover Metadata and Semantics Research (MTSR 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 672))

Included in the following conference series:

Abstract

Linked Open Data (LOD) is a method of publishing machine-readable open data so that it can be interlinked and become more useful through semantic querying. The decentralized nature of the current LOD cloud relies on location-specific services, which is known to result in problems of availability and broken links. Current approaches to peer-to-peer (P2P) decentralized file systems could be used to support better availability and performance and provide permanent data, while preserving LOD principles. Applications would also benefit from mechanisms that ensure that LOD entities are permanent and immutable, independently of their original publishers. This paper outlines a first prototype design of LOD over the Interplanetary File System (IPFS), a P2P system based on Merkel DAGs and a content-addressed block storage model. The fundamental ideas on that implementation are discussed and an example implementation on the early version of IPFS is described, showing the feasibility of such approach and its main differentiating features.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://sunlightfoundation.com/policy/documents/ten-open-data-principles/.

  2. 2.

    Note this is a reference for the first draft, now superseded by more complete versions.

  3. 3.

    https://www.w3.org/TR/void/.

  4. 4.

    http://www.iana.org/assignments/well-known-uris/well-known-uris.xhtml.

  5. 5.

    Note that this paper was writing before that specification was published in Github, so some of the ideas on this paper may need re-working to be fully IPLD compatible.

  6. 6.

    https://github.com/ipld/specs/tree/master/ipld.

  7. 7.

    http://data.ordnancesurvey.co.uk/datasets/50k-gazetteer.

  8. 8.

    http://lod-cloud.net/.

  9. 9.

    https://datahub.io/dataset/ordnance-survey-linked-data.

  10. 10.

    http://data.ordnancesurvey.co.uk/.well-known/void.

  11. 11.

    https://github.com/doesntgolf/ipfs-search.

  12. 12.

    https://pypi.python.org/pypi/Sickle.

References

  1. Alexander, K., Hausenblas, M.: Describing linked datasets-on the design and usage of VoID, the vocabulary of interlinked datasets. In: Linked Data on the Web Workshop (LDOW 2009), in Conjunction with 18th International World Wide Web Conference (WWW 2009) (2009)

    Google Scholar 

  2. Benet, J.: IPFS-Content Addressed, Versioned, P2P File System. arXiv preprint arXiv:1407.3561 (2014)

  3. Bizer, C., Heath, T., Berners-Lee, T.: Linked data-the story so far. In: Emerging Concepts, Semantic Services, Interoperability and Web Applications, pp. 205–227 (2009)

    Google Scholar 

  4. Cabello, F., Franco, M.G., Haché, A.: The social web beyond ‘Walled Gardens’: interoperability, federation and the case of Lorea/n-1. PsychNology J. 11(1), 43–65 (2013)

    Google Scholar 

  5. Fernández, J. D., Polleres, A., Umbrich, J.: Towards efficient archiving of dynamic linked open data. In: Proceedings of DIACHRON, pp. 34–49 (2015)

    Google Scholar 

  6. Gonzalez, J.E., Xin, R.S., Dave, A., Crankshaw, D., Franklin, M.J., Stoica, I.: Graph processing in a distributed dataflow framework. In: 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2014), pp. 599–613 (2014)

    Google Scholar 

  7. Haslhofer, B., Isaac, A.: Data.europeana.eu: The Europeana Linked Open Data pilot. In International Conference on Dublin Core and Metadata Applications, pp. 94–104 (2011)

    Google Scholar 

  8. Hausenblas, M., Karnstedt, M.: Understanding linked open data as a web-scale database. In: 2010 Second International Conference on Advances in Databases Knowledge and Data Applications (DBKDA), pp. 56–61. IEEE (2010)

    Google Scholar 

  9. Janssen, M., Charalabidis, Y., Zuiderwijk, A.: Benefits, adoption barriers and myths of open data and open government. Inf. Syst. Manag. 29(4), 258–268 (2012)

    Article  Google Scholar 

  10. Johnson, J.A.: From open data to information justice. Ethics Inf. Technol. 16(4), 263–274 (2014)

    Article  Google Scholar 

  11. Khayyat, M., Bannister, F.: Open data licensing: more than meets the eye. Inf. Polity 20(4), 231–252 (2015)

    Article  Google Scholar 

  12. Konstantinou, N., Spanos, D.E.: Methodologies and software tools. In: Materializing the Web of Linked Data, pp. 51–71. Springer International Publishing, Switzerland (2015)

    Google Scholar 

  13. Langille, M.G., Eisen, J.A.: BioTorrents: a file sharing service for scientific data. PLoS One 5(4), e10071 (2010)

    Article  Google Scholar 

  14. Lanthaler, M., Gtl, C.: On using JSON-LD to create evolvable RESTful services. In: Proceedings of the Third International Workshop on RESTful Design, pp. 25–32. ACM (2012)

    Google Scholar 

  15. Liu, G., Shen, H., Ward, L.: An efficient and trustworthy P2P and social network integrated file sharing system. IEEE Trans. Comput. 64(1), 54–70 (2015)

    Article  MathSciNet  Google Scholar 

  16. Missier, P., Belhajjame, K., Cheney, J.: The W3C PROV family of specifications for modelling provenance metadata. In: Proceedings of the 16th International Conference on Extending Database Technology, pp. 773–776. ACM (2013)

    Google Scholar 

  17. Rajabi, E., SanchezAlonso, S., Sicilia, M.A.: Analyzing broken links on the web of data: an experiment with DBpedia. J. Assoc. Inf. Sci. Technol. 65(8), 1721–1727 (2014)

    Article  Google Scholar 

  18. Schmachtenberg, M., Bizer, C., Paulheim, H.: Adoption of the linked data best practices in different topical domains. In: Mika, P., Tudorache, T., Bernstein, A., Welty, C., Knoblock, C., Vrandečić, D., Groth, P., Noy, N., Janowicz, K., Goble, C. (eds.) ISWC 2014. LNCS, vol. 8796, pp. 245–260. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11964-9_16

    Google Scholar 

  19. Wong, A., Liu, V., Caelli, W., Sahama, T.: An architecture for trustworthy open data services. In: Jensen, C.D., Marsh, S., Dimitrakos, T., Murayama, Y. (eds.) Trust Management IX. IFIP, pp. 149–162. Springer International Publishing, Switzerland (2015)

    Google Scholar 

  20. Zaveri, A., Rula, A., Maurino, A., Pietrobon, R., Lehmann, J., Auer, S.: Quality assessment for linked data: a survey. Semant. Web 7(1), 63–93 (2015)

    Article  Google Scholar 

  21. Zuiderwijk, A., Janssen, M.: Open data policies, their implementation and impact: a framework for comparison. Govern. Inf. Q. 31(1), 17–29 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, University of Alcalá, Polytechnic Building, Ctra. Barcelona Km. 33.6, 28871, Alcalá de Henares, Madrid, Spain

    Miguel-Angel Sicilia, Salvador Sánchez-Alonso & Elena García-Barriocanal

Authors
  1. Miguel-Angel Sicilia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Salvador Sánchez-Alonso
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elena García-Barriocanal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel-Angel Sicilia .

Editor information

Editors and Affiliations

  1. Alexander Technological Educational Institute of Thessaloniki, Thessaloniki, Greece

    Emmanouel Garoufallou

  2. Alexander Technological Educational Inst , Rome, Italy

    Imma Subirats Coll

  3. Sapienza University of Rome , Rome, Italy

    Armando Stellato

  4. Drexel University, Philadelphia, Pennsylvania, USA

    Jane Greenberg

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Sicilia, MA., Sánchez-Alonso, S., García-Barriocanal, E. (2016). Sharing Linked Open Data over Peer-to-Peer Distributed File Systems: The Case of IPFS. In: Garoufallou, E., Subirats Coll, I., Stellato, A., Greenberg, J. (eds) Metadata and Semantics Research. MTSR 2016. Communications in Computer and Information Science, vol 672. Springer, Cham. https://doi.org/10.1007/978-3-319-49157-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49157-8_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49156-1

  • Online ISBN: 978-3-319-49157-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation