skip to main content
research-article

GRASP: Scalable Graph Alignment by Spectral Corresponding Functions

Published:24 February 2023Publication History
Skip Abstract Section

Abstract

What is the best way to match the nodes of two graphs? This graph alignment problem generalizes graph isomorphism and arises in applications from social network analysis to bioinformatics. Some solutions assume that auxiliary information on known matches or node or edge attributes is available, or utilize arbitrary graph features. Such methods fare poorly in the pure form of the problem, in which only graph structures are given. Other proposals translate the problem to one of aligning node embeddings, yet, by doing so, provide only a single-scale view of the graph.

In this article, we transfer the shape-analysis concept of functional maps from the continuous to the discrete case, and treat the graph alignment problem as a special case of the problem of finding a mapping between functions on graphs. We present GRASP, a method that first establishes a correspondence between functions derived from Laplacian matrix eigenvectors, which capture multiscale structural characteristics, and then exploits this correspondence to align nodes. We enhance the basic form of GRASP by altering two of its components, namely the embedding method and the assignment procedure it employs, leveraging its modular, hence adaptable design. Our experimental study, featuring noise levels higher than anything used in previous studies, shows that the enhanced form of GRASP outperforms scalable state-of-the-art methods for graph alignment across noise levels and graph types, and performs competitively with respect to the best non-scalable ones. We include in our study another modular graph alignment algorithm, CONE, which is also adaptable thanks to its modular nature, and show it can manage graphs with skewed power-law degree distributions.

REFERENCES

  1. [1] Abdulrahim Mohammad Abdulkader. 1998. Parallel Algorithms for Labeled Graph Matching. Ph.D. Dissertation. Colorado School of Mines.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Absil Pierre-Antoine, Baker Christopher G., and Gallivan Kyle A.. 2007. Trust-region methods on Riemannian manifolds. Foundations of Computational Mathematics 7, 3 (2007), 303330.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Aladağ Ahmet E. and Erten Cesim. 2013. SPINAL: Scalable protein interaction network alignment. Bioinformatics 29, 7 (2013), 917924.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] Bayati Mohsen, Gleich David F., Saberi Amin, and Wang Ying. 2013. Message-passing algorithms for sparse network alignment. Transactions on Knowledge Discovery from Data 7, 1 (2013), 3:1–3:31.Google ScholarGoogle Scholar
  5. [5] Belkin Mikhail and Niyogi Partha. 2006. Convergence of Laplacian eigenmaps. In Proceedings of the 19th International Conference on Neural Information Processing Systems. 129136.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Besl Paul J. and McKay Neil D.. 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2 (1992), 239256.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. [7] Chen Xiyuan, Heimann Mark, Vahedian Fatemeh, and Koutra Danai. 2020. CONE-align: Consistent network alignment with proximity-preserving node embedding. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 19851988.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. [8] Chu Xiaokai, Fan Xinxin, Yao Di, Zhu Zhihua, Huang Jianhui, and Bi Jingping. 2019. Cross-network embedding for multi-network alignment. In Proceedings of the World Wide Web Conference. 273284.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Chung Fan R. K.. 1997. Spectral Graph Theory. Vol. 92. American Mathematical Soc.Google ScholarGoogle Scholar
  10. [10] Cohen-Steiner David, Kong Weihao, Sohler Christian, and Valiant Gregory. 2018. Approximating the spectrum of a graph. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 12631271.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] Davis Stephen, Abbasi Babak, Shah Shrupa, Telfer Sandra, and Begon Mike. 2015. Spatial analyses of wildlife contact networks. Journal of the Royal Society Interface 12, 102 (2015). .Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] Derr Tyler, Karimi Hamid, Liu Xiaorui, Xu Jiejun, and Tang Jiliang. 2021. Deep adversarial network alignment. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 352361.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Doka Katerina, Xue Mingqiang, Tsoumakos Dimitrios, and Karras Panagiotis. 2015. \(k\)-anonymization by freeform generalization. In Proceedings of the 10th ACM Symposium on Information, Computer and Communications Security. 519530.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. [14] Fan Zhou, Mao Cheng, Wu Yihong, and Xu Jiaming. 2020. Spectral graph matching and regularized quadratic relaxations: Algorithm and theory. In Proceedings of the 37th International Conference on Machine Learning. 29852995.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Feizi Soheil, Quon Gerald T., Mendoza Mariana Recamonde, Médard Muriel, Kellis Manolis, and Jadbabaie Ali. 2020. Spectral alignment of graphs. IEEE Transactions on Network Science and Engineering 7, 3 (2020), 11821197.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Fournet Julie and Barrat Alain. 2014. Contact patterns among high school students. PloS One 9, 9 (2014), e107878.Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Gallot Sylvestre, Hulin Dominique, and Lafontaine Jacques. 1990. Riemannian Geometry. Springer.Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Gao Ji, Huang Xiao, and Li Jundong. 2021. Unsupervised graph alignment with Wasserstein distance discriminator. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 426435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Hamilton William L.. 2020. Graph representation learning. Synthesis Lectures on Artifical Intelligence and Machine Learning 14, 3 (2020), 1159.Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Heimann Mark, Shen Haoming, Safavi Tara, and Koutra Danai. 2018. REGAL: Representation learning-based graph alignment. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 117126.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Hermanns Judith, Tsitsulin Anton, Munkhoeva Marina, Bronstein Alexander, Mottin Davide, and Karras Panagiotis. 2021. GRASP: Graph alignment through spectral signatures. In Proceedings of the Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint International Conference on Web and Big Data.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. [22] Jonker Roy and Volgenant Anton. 1987. A shortest augmenting path algorithm for dense and sparse linear assignment problems. Computing 38, 4 (1987), 325340.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. [23] Karakasis Paris A., Konar Aritra, and Sidiropoulos Nicholas D.. 2021. Joint graph embedding and alignment with spectral pivot. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 851859.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Karras Panagiotis and Mamoulis Nikos. 2008. Hierarchical synopses with optimal error guarantees. ACM Transactions on Database Systems 33, 3 (2008), 18:1–18:53.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. [25] Kazemi Ehsan, Hassani Seyed Hamed, and Grossglauser Matthias. 2015. Growing a graph matching from a handful of seeds. Proceedings of the VLDB Endowment 8, 10 (2015), 10101021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Klau Gunnar W.. 2009. A new graph-based method for pairwise global network alignment. BMC Bioinformatics 10, S-1 (2009). .Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Knossow David, Sharma Avinash, Mateus Diana, and Horaud Radu. 2009. Inexact matching of large and sparse graphs using Laplacian eigenvectors. In Proceedings of the 7th IAPR-TC-15 International Workshop on Graph-Based Representations in Pattern Recognition. Vol. 5534, Springer, 144153.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. [28] Kobler Johannes, Schöning Uwe, and Torán Jacobo. 2012. The Graph Isomorphism Problem: Its Structural Complexity. Springer Science & Business Media.Google ScholarGoogle Scholar
  29. [29] Kollias Giorgos, Sathe Madan, Mohammadi Shahin, and Grama Ananth. 2013. A fast approach to global alignment of protein-protein interaction networks. BMC Research Notes 6, 1 (2013), 35.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Koutis Ioannis, Levin Alex, and Peng Richard. 2016. Faster spectral sparsification and numerical algorithms for SDD matrices. ACM Transactions on Algorithms 12, 2 (2016), 17:1–17:16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Koutra Danai, Tong Hanghang, and Lubensky David. 2013. BIG-ALIGN: Fast bipartite graph alignment. In Proceedings of the 2013 IEEE 13th International Conference on Data Mining. 389398.Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Kovnatsky Artiom, Bronstein Michael M., Bronstein Alexander M., Glashoff Klaus, and Kimmel Ron. 2013. Coupled quasi-harmonic bases. Computer Graphics Forum 32, 2 (2013), 439448.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Kunegis Jérôme. 2013. KONECT – The Koblenz network collection. In Proceedings of the 22nd International Conference on World Wide Web. 13431350.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Kyster Alexander Frederiksen, Nielsen Simon Daugaard, Hermanns Judith, Mottin Davide, and Karras Panagiotis. 2021. Boosting graph alignment algorithms. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 31663170.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. [35] Leskovec Jure and Krevl Andrej. 2014. SNAP Datasets: Stanford Large Network Dataset Collection. Retrieved 06 October 2022 from http://snap.stanford.edu/data.Google ScholarGoogle Scholar
  36. [36] Liao Chung-Shou, Lu Kanghao, Baym Michael, Singh Rohit, and Berger Bonnie. 2009. IsoRankN: Spectral methods for global alignment of multiple protein networks. Bioinformatics 25, 12 (2009), i253–i258.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Litany Or, Rodolà Emanuele, Bronstein Alexander M., and Bronstein Michael M.. 2017. Fully spectral partial shape matching. Computer Graphics Forum 36, 2 (2017), 247258.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. [38] Liu Li, Cheung William K., Li Xin, and Liao Lejian. 2016. Aligning users across social networks using network embedding. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 17741780.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. [39] Malmi Eric, Gionis Aristides, and Terzi Evimaria. 2017. Active network alignment: A matching-based approach. In Proceedings of the 2017 ACM International Conference on Information and Knowledge Management. 16871696.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Man Tong, Shen Huawei, Liu Shenghua, Jin Xiaolong, and Cheng Xueqi. 2016. Predict anchor links across social networks via an embedding approach. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. IJCAI/AAAI Press, 18231829.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. [41] Nassar Huda, Veldt Nate, Mohammadi Shahin, Grama Ananth, and Gleich David F.. 2018. Low rank spectral network alignment. In Proceedings of the 2018 World Wide Web Conference. 619628.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. [42] Newman Mark E. J.. 2003. The structure and function of complex networks. SIAM Review 45, 2 (2003), 167256.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. [43] Newman Mark E. J.. 2005. Power laws, pareto distributions and Zipf’s law. Contemporary Physics 46, 5 (2005), 323351.Google ScholarGoogle ScholarCross RefCross Ref
  44. [44] Nobari Sadegh, Karras Panagiotis, Pang HweeHwa, and Bressan Stéphane. 2014. \(L\)-opacity: Linkage-aware graph anonymization. In Proceedings of the 17th International Conference on Extending Database Technology. 583594.Google ScholarGoogle Scholar
  45. [45] Ovsjanikov Maks, Ben-Chen Mirela, Solomon Justin, Butscher Adrian, and Guibas Leonidas J.. 2012. Functional maps: A flexible representation of maps between shapes. ACM Transactions on Graphics 31, 4 (2012), 30:1–30:11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. [46] Page Lawrence, Brin Sergey, Motwani Rajeev, and Winograd Terry. 1999. The PageRank Citation Ranking: Bringing Order to the Web.Technical Report. Stanford InfoLab.Google ScholarGoogle Scholar
  47. [47] Perozzi Bryan, Al-Rfou Rami, and Skiena Steven. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 701710.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. [48] Qiu Jiezhong, Dong Yuxiao, Ma Hao, Li Jian, Wang Kuansan, and Tang Jie. 2018. Network embedding as matrix factorization: Unifying deepwalk, line, pte, and node2vec. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 459467.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Ribeiro Leonardo F. R., Saverese Pedro H. P., and Figueiredo Daniel R.. 2017. struc2vec: Learning node representations from structural identity. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 385394.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. [50] Robertson Charles. 1928. Flowers and Insects: Lists of Visitors to Four Hundred and Fifty-Three Flowers. n.p., Carlinville, Ill.Google ScholarGoogle Scholar
  51. [51] Safavi Tara, Belth Caleb, Faber Lukas, Mottin Davide, Müller Emmanuel, and Koutra Danai. 2019. Personalized knowledge graph summarization: From the cloud to your pocket. In Proceedings of the 2019 IEEE International Conference on Data Mining. 528537.Google ScholarGoogle ScholarCross RefCross Ref
  52. [52] Schönemann Peter H.. 1966. A generalized solution of the orthogonal procrustes problem. Psychometrika 31, 1 (1966), 110.Google ScholarGoogle ScholarCross RefCross Ref
  53. [53] Shi Jianbo and Malik Jitendra. 2000. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8 (2000), 888905.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. [54] Singh Rohit, Xu Jinbo, and Berger Bonnie. 2008. Global alignment of multiple protein interaction networks with application to functional orthology detection. Proceedings of the National Academy of Sciences of the United States of America 105, 35 (2008), 1276312768.Google ScholarGoogle ScholarCross RefCross Ref
  55. [55] Tsitsulin Anton, Mottin Davide, Karras Panagiotis, Bronstein Alexander M., and Müller Emmanuel. 2018. NetLSD: Hearing the shape of a graph. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 23472356.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. [56] Tsitsulin Anton, Mottin Davide, Karras Panagiotis, and Müller Emmanuel. 2018. VERSE: Versatile graph embeddings from similarity measures. In Proceedings of the 2018 World Wide Web Conference. 539548.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. [57] Tsitsulin Anton, Munkhoeva Marina, Mottin Davide, Karras Panagiotis, Oseledets Ivan V., and Müller Emmanuel. 2021. FREDE: Anytime graph embeddings. Proceedings of the VLDB Endowment 14, 6 (2021), 11021110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. [58] Umeyama Shinj. 1988. An eigendecomposition approach to weighted graph matching problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 5 (1988), 695703.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. [59] Vijayan Vipin and Milenković Tijana. 2018. Multiple network alignment via MultiMAGNA++. IEEE/ACM Transactions on Computational Biology and Bioinformatics 15, 5 (2018), 16691682.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. [60] Xiong Hao, Yan Junchi, and Pan Li. 2021. Contrastive multi-view multiplex network embedding with applications to robust network alignment. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 19131923.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. [61] Xu Hongteng, Luo Dixin, and Carin Lawrence. 2019. Scalable Gromov-Wasserstein learning for graph partitioning and matching. In Proceedings of the 33rd International Conference on Neural Information Processing Systems. 30463056.Google ScholarGoogle Scholar
  62. [62] Xu Hongteng, Luo Dixin, Zha Hongyuan, and Carin Lawrence. 2019. Gromov-Wasserstein learning for graph matching and node embedding. In Proceedings of the International Conference on Machine Learning. 69326941.Google ScholarGoogle Scholar
  63. [63] Xue Mingqiang, Karras Panagiotis, Raïssi Chedy, Kalnis Panos, and Pung Hung Keng. 2012. Delineating social network data anonymization via random edge perturbation. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management. 475484.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. [64] Yan Yuchen, Zhang Si, and Tong Hanghang. 2021. BRIGHT: A Bridging algorithm for network alignment. In Proceedings of the Web Conference. 39073917.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. [65] Yartseva Lyudmila and Grossglauser Matthias. 2013. On the performance of percolation graph matching. In Proceedings of the 1st ACM Conference on Online Social Networks. 119130.Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. [66] Yasar Abdurrahman and Çatalyürek Ümit V.. 2018. An iterative global structure-assisted labeled network aligner. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 26142623.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. [67] Zhang Si and Tong Hanghang. 2016. FINAL: Fast attributed network alignment. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 13451354.Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. [68] Zhang Si, Tong Hanghang, Jin Long, Xia Yinglong, and Guo Yunsong. 2021. Balancing consistency and disparity in network alignment. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 22122222.Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. [69] Zhou Fan, Liu Lei, Zhang Kunpeng, Trajcevski Goce, Wu Jin, and Zhong Ting. 2018. Deeplink: A deep learning approach for user identity linkage. In Proceedings of the IEEE Conference on Computer Communications. 13131321.Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. [70] Zhou Qinghai, Li Liangyue, Wu Xintao, Cao Nan, Ying Lei, and Tong Hanghang. 2021. Attent: Active attributed network alignment. In Proceedings of the Web Conference. 38963906.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. [71] Zhou Yang, Zhang Zeru, Wu Sixing, Sheng Victor S., Han Xiaoying, Zhang Zijie, and Jin Ruoming. 2021. Robust network alignment via attack signal scaling and adversarial perturbation elimination. In Proceedings of the Web Conference. 38843895.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. GRASP: Scalable Graph Alignment by Spectral Corresponding Functions

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Knowledge Discovery from Data
            ACM Transactions on Knowledge Discovery from Data  Volume 17, Issue 4
            May 2023
            364 pages
            ISSN:1556-4681
            EISSN:1556-472X
            DOI:10.1145/3583065
            Issue’s Table of Contents

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 24 February 2023
            • Online AM: 15 September 2022
            • Accepted: 19 August 2022
            • Revised: 18 August 2022
            • Received: 5 December 2021
            Published in tkdd Volume 17, Issue 4

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
          • Article Metrics

            • Downloads (Last 12 months)318
            • Downloads (Last 6 weeks)20

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Full Text

          View this article in Full Text.

          View Full Text

          HTML Format

          View this article in HTML Format .

          View HTML Format