Skip to main content

evolve2vec: Learning Network Representations Using Temporal Unfolding

  • Conference paper
  • First Online:
Book cover MultiMedia Modeling (MMM 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11295))

Included in the following conference series:

Abstract

In the past few years, various methods have been developed that attempt to embed graph nodes (e.g. users that interact through a social platform) onto low-dimensional vector spaces, exploiting the relationships (commonly displayed as edges) among them. The extracted vector representations of the graph nodes are then used to effectively solve machine learning tasks such as node classification or link prediction. These methods, however, focus on the static properties of the underlying networks, neglecting the temporal unfolding of those relationships. This affects the quality of representations, since the edges don’t encode the response times (i.e. speed) of the users’ (i.e. nodes) interactions. To overcome this limitation, we propose an unsupervised method that relies on temporal random walks unfolding at the same timescale as the evolution of the underlying dataset. We demonstrate its superiority against state-of-the-art techniques on the tasks of hidden link prediction and future link forecast. Moreover, by interpolating between the fully static and fully temporal setting, we show that the incorporation of topological information of past interactions can further increase our method efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    However, many other processes can be represented as an ordered sequence.

References

  1. Ahmed, A., Shervashidze, N., Narayanamurthy, S., Josifovski, V., Smola, A.J.: Distributed large-scale natural graph factorization. In: Proceedings of the 22nd International Conference on World Wide Web. WWW 2013, pp. 37–48. ACM, New York (2013)

    Google Scholar 

  2. Cai, H., Zheng, V.W., Chang, K.C.C.: A comprehensive survey of graph embedding: problems, techniques and applications. arXiv:1709.07604 [cs.AI] (2018)

    Article  Google Scholar 

  3. Gehrke, J., Ginsparg, P., Kleinberg, J.: Overview of the 2003 KDD cup. SIGKDD Explor. Newsl. 5(2), 149–151 (2003)

    Article  Google Scholar 

  4. Goyal, P., Kamra, N., He, X., Liu, Y.: DynGEM: deep embedding method for dynamic graphs (2017). http://www-scf.usc.edu/~nkamra/pdf/dyngem.pdf

  5. Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. ACM, New York (2016)

    Google Scholar 

  6. Hamilton, W.L., Leskovec, J., Jurafsky, D.: Diachronic word embeddings reveal statistical laws of semantic change. arXiv:1605.09096 [cs.CL] (2016)

  7. Hogg, T., Lerman, K.: Social dynamics of Digg. EPJ Data Sci. 1(1), 5 (2012). https://doi.org/10.1140/epjds5

  8. Klimt, B., Yang, Y.: The enron corpus: a new dataset for email classification research. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS (LNAI), vol. 3201, pp. 217–226. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30115-8_22

    Chapter  Google Scholar 

  9. Lü, L., Zhou, T.: Link prediction in complex networks: a survey. Physica A: Stati. Mech. Appl. 390(6), 1150–1170 (2011)

    Article  Google Scholar 

  10. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arxiv:1301.3781 [cs.CL] (2013)

  11. Mislove, A.E.: Online social networks: measurement, analysis, and applications to distributed information systems. Ph.D. thesis, Rice University (2009)

    Google Scholar 

  12. Pandhre, S., Mittal, H., Gupta, M., Balasubramanian, V.N.: STwalk: learning trajectory representations in temporal graphs. arXiv:1711.04150 [cs.SI] (2018)

  13. Perozzi, B., Al-Rfou, R., Skiena, S.: DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710. ACM, New York (2014)

    Google Scholar 

  14. Starnini, M., Baronchelli, A., Barrat, A., Pastor-Satorras, R.: Random walks on temporal networks. Phys. Rev. E 85, 056115 (2012)

    Article  Google Scholar 

  15. Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: LINE: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. WWW 2015, pp. 1067–1077 (2015)

    Google Scholar 

  16. Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD 2016, pp. 1225–1234. ACM, New York (2016)

    Google Scholar 

  17. Zhiyuli, A., Liang, X., Xu, Z.: Learning distributed representations for large-scale dynamic social networks. In: IEEE INFOCOM 2017 - IEEE Conference on Computer Communications, pp. 1–9, May 2017

    Google Scholar 

Download references

Acknowledgments

The work presented in this paper was supported by the European Commission under contract H2020-700381 ASGARD.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Theodoros Semertzidis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bastas, N., Semertzidis, T., Axenopoulos, A., Daras, P. (2019). evolve2vec: Learning Network Representations Using Temporal Unfolding. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11295. Springer, Cham. https://doi.org/10.1007/978-3-030-05710-7_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-05710-7_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-05709-1

  • Online ISBN: 978-3-030-05710-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics