Skip to main content

A Configurable Evaluation Framework for Node Embedding Techniques

  • Conference paper
  • First Online:
The Semantic Web: ESWC 2019 Satellite Events (ESWC 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11762))

Included in the following conference series:

Abstract

While Knowledge Graphs (KG) are graph shaped by nature, most traditional data mining and machine learning (ML) software expect data in a vector form. Several node embedding techniques have been proposed to represent each node in the KG as a low-dimensional feature vector. A node embedding technique should preferably be task independent. Therefore, when a new method has been developed, it should be tested on the tasks it was designed for as well as on other tasks. We present the design and implementation of a ready to use evaluation framework to simplify the node embedding technique testing phase. The provided tests range from ML tasks, semantic tasks to semantic analogies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/mariaangelapellegrino/Evaluation-Framework.

  2. 2.

    https://doi.org/10.5281/zenodo.1318146.

  3. 3.

    https://doi.org/10.5281/zenodo.2017356.

References

  1. Cochez, M., Ristoski, P., Ponzetto, S.P., Paulheim, H.: Global RDF vector space embeddings. In: 16th International Semantic Web Conference ISWC (2017)

    Google Scholar 

  2. Goyal, P., Ferrara, E.: Graph embedding techniques, applications, and performance: a survey. Knowl.-Based Syst. 151, 78–94 (2018)

    Article  Google Scholar 

  3. Hoffart, J., Seufert, S., Nguyen, D.B., Theobald, M., Weikum, G.: KORE: keyphrase overlap relatedness for entity disambiguation. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management (2012)

    Google Scholar 

  4. Lee, M.D., Welsh, M.: An empirical evaluation of models of text document similarity. In: XXVII Annual Conference of the Cognititive Science Society (2005)

    Google Scholar 

  5. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: 27th Annual Conference on Neural Information Processing Systems (2013)

    Google Scholar 

  6. Ristoski, P., Rosati, J., Di Noia, T., De Leone, R., Paulheim, H.: RDF2Vec: RDF graph embeddings and their applications. Semant. Web J. 10(4), 721–752 (2018). in press

    Article  Google Scholar 

  7. Ristoski, P., de Vries, G.K.D., Paulheim, H.: A collection of benchmark datasets for systematic evaluations of machine learning on the semantic web. In: Groth, P., et al. (eds.) ISWC 2016. LNCS, vol. 9982, pp. 186–194. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46547-0_20

    Chapter  Google Scholar 

  8. Rulinda, J., de Dieu Tugirimana, J., Nzaramba, A., Aila, F.O., Langat, G.K.: An integrated platform to evaluate graph embedding. Int. J. Sci. Eng. Res. 9, 665–676 (2018)

    Google Scholar 

  9. Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd International Conference on Knowledge Discovery and Data Mining (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria Angela Pellegrino .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pellegrino, M.A., Cochez, M., Garofalo, M., Ristoski, P. (2019). A Configurable Evaluation Framework for Node Embedding Techniques. In: Hitzler, P., et al. The Semantic Web: ESWC 2019 Satellite Events. ESWC 2019. Lecture Notes in Computer Science(), vol 11762. Springer, Cham. https://doi.org/10.1007/978-3-030-32327-1_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32327-1_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32326-4

  • Online ISBN: 978-3-030-32327-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics