skip to main content
10.1145/3539618.3591762acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

SCHash: Speedy Simplicial Complex Neural Networks via Randomized Hashing

Published: 18 July 2023 Publication History

Abstract

Graphs, as a non-linear data structure, are ubiquitous in practice, and efficient graph analysis can benefit important information retrieval applications in the era of big data. Currently, one of the fundamental graph mining problems is graph embedding, which aims to represent the graph as a low-dimensional feature vector with the content and structural information in the graph preserved. Although the graph embedding technique has evolved considerably, traditional methods mainly focus on node pairwise relationship in graphs, which makes the representational power of such schemes limited. Recently, a number of works have explored the simplicial complexes, which describe the higher-order interactions between nodes in the graphs, and further proposed several Graph Neural Network (GNN) algorithms based on simplicial complexes. However, these GNN approaches are highly inefficient in terms of running time and space, due to massive parameter learning. In this paper, we propose a simple and speedy graph embedding algorithm dubbed SCHash. Through adopting the Locality Sensitive Hashing (LSH) technique, SCHash captures the higher-order information derived from the simplicial complex in the GNN framework, and it can achieve a good balance between accuracy and efficiency. Our extensive experiments clearly show that, in terms of accuracy, the performance of our proposed SCHash algorithm is comparable to that of state-of-the-art GNN algorithms; also, SCHash achieves higher accuracy than the existing LSH algorithms. In terms of efficiency, SCHash runs faster than GNN algorithms by 2 ~ 4 orders of magnitude, and is more efficient than the existing LSH algorithms.

Supplemental Material

MP4 File
Presentation video about the paper titled SCHash: Speedy Simplicial Complex Neural Networks via Randomized Hashing.

References

[1]
Devanshu Arya, Deepak K. Gupta, Stevan Rudinac, and Marcel Worring. 2020. HyperSAGE: Generalizing Inductive Representation Learning on Hypergraphs. CoRR abs/2010.04558 (2020).
[2]
Song Bai, Feihu Zhang, and Philip HS Torr. 2021. Hypergraph Convolution and Hypergraph Attention. Pattern Recognition 110 (2021), 107637.
[3]
Debajyoti Bera, Rameshwar Pratap, Bhisham Dev Verma, Biswadeep Sen, and Tanmoy Chakraborty. 2023. QUINT: Node Embedding using Network Hashing. IEEE Transactions on Knowledge and Data Engineering 35, 3 (2023), 2987--3000.
[4]
Cristian Bodnar, Fabrizio Frasca, Nina Otter, Yuguang Wang, Pietro Lio, Guido F Montufar, and Michael Bronstein. 2021. Weisfeiler and Lehman go Cellular: CW Networks. In NeurIPS. 2625--2640.
[5]
Cristian Bodnar, Fabrizio Frasca, Yuguang Wang, Nina Otter, Guido F Montufar, Pietro Lio, and Michael Bronstein. 2021. Weisfeiler and Lehman go Topological: Message Passing Simplicial Networks. In ICML. 1026--1037.
[6]
Jean-Daniel Boissonnat and Clément Maria. 2014. The Simplex Tree: An Efficient Data Structure for General Simplicial Complexes. Algorithmica 70, 3 (2014), 406--427.
[7]
Karsten M Borgwardt and Hans-Peter Kriegel. 2005. Shortest-Path Kernels on Graphs. In ICDM. 74--81.
[8]
Giorgos Bouritsas, Fabrizio Frasca, Stefanos P Zafeiriou, and Michael Bronstein. 2022. Improving Graph Neural Network Expressivity via Subgraph Isomorphism Counting. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
[9]
Andrei Z Broder, Moses Charikar, Alan M Frieze, and Michael Mitzenmacher. 1998. Min-wise Independent Permutations. In STOC. 327--336.
[10]
Abdulkadir Celikkanat, Fragkiskos D Malliaros, and Apostolos N Papadopoulos. 2022. NODESIG: Binary Node Embeddings via Random Walk Diffusion. In ASONAM. 68--75.
[11]
Moses S Charikar. 2002. Similarity Estimation Techniques from Rounding Algorithms. In STOC. 380--388.
[12]
Mingyang Chen, Wen Zhang, Yushan Zhu, Hongting Zhou, Zonggang Yuan, Changliang Xu, and Huajun Chen. 2022. Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding. In SIGIR. 927--937.
[13]
Yuzhou Chen, Yulia R Gel, and H Vincent Poor. 2022. BScNets: Block Simplicial Complex Neural Networks. In AAAI. 6333--6341.
[14]
Zhengdao Chen, Lei Chen, Soledad Villar, and Joan Bruna. 2020. Can Graph Neural Networks Count Substructures?. In NeurIPS. 10383--10395.
[15]
Chanyoung Chung and Joyce Jiyoung Whang. 2021. Knowledge Graph Embedding via Metagraph Learning. In SIGIR. 2212--2216.
[16]
Limeng Cui and Dongwon Lee. 2022. KETCH: Knowledge Graph Enhanced Thread Recommendation in Healthcare Forums. In SIGIR. 492--501.
[17]
David Easley and Jon Kleinberg. 2010. Networks, Crowds, and Markets: Reasoning about A Highly Connected World.
[18]
Stefania Ebli, Michaël Defferrard, and Gard Spreemann. 2020. Simplicial Neural Networks. In NeurIPS 2020 Workshop on Topological Data Analysis and Beyond.
[19]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable Feature Learning for Networks. In KDD. 855--864.
[20]
Celia Hacker. 2020. K-simplex2vec: A Simplicial Extension of Node2vec. In NeurIPS 2020 Workshop on Topological Data Analysis and Beyond.
[21]
Wassily Hoeffding. 1963. Probability Inequalities for Sums of Bounded Random Variables. Journal of the American statistical association 58, 301 (1963), 13--30.
[22]
Hisashi Kashima, Koji Tsuda, and Akihiro Inokuchi. 2003. Marginalized Kernels between Labeled Graphs. In ICML. 321--328.
[23]
Kristian Kersting, Nils M. Kriege, Christopher Morris, Petra Mutzel, and Marion Neumann. 2016. Benchmark Data Sets for Graph Kernels. http:// graphkernels.cs.tu-dortmund.de
[24]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR.
[25]
Steffen Klamt, Utz-Uwe Haus, and Fabian Theis. 2009. Hypergraphs and Cellular Networks. PLoS Computational Biology 5, 5 (2009), e1000385.
[26]
Geon Lee, Seonggoo Kang, and Joyce Jiyoung Whang. 2019. Hyperlink Classification via Structured Graph Embedding. In SIGIR. 1017--1020.
[27]
See Hian Lee, Feng Ji, and Wee Peng Tay. 2022. SGAT: Simplicial Graph Attention Network. In IJCAI. 3192--3200.
[28]
Bin Li, Xingquan Zhu, Lianhua Chi, and Chengqi Zhang. 2012. Nested Subtree Hash Kernels for Large-scale Graph Classification over Streams. In ICDM. 399--408.
[29]
Yao Ma, Ziyi Guo, Zhaocun Ren, Jiliang Tang, and Dawei Yin. 2020. Streaming Graph Neural Networks. In SIGIR. 719--728.
[30]
Christopher Morris, Nils M Kriege, Kristian Kersting, and Petra Mutzel. 2016. Faster Kernels for Graphs with Continuous Attributes via Hashing. In ICDM. 1095--1100.
[31]
Abubakr Muhammad and Magnus Egerstedt. 2006. Control Using Higher Order Laplacians in Network Topologies. In MTNS. 1024--1038.
[32]
Marion Neumann, Roman Garnett, Christian Bauckhage, and Kristian Kersting. 2016. Propagation Kernels: Efficient Graph Kernels from Propagated Information. Machine Learning 102 (2016), 209--245.
[33]
Mark Newman. 2018. Networks.
[34]
Yunsheng Pang, Yunxiang Zhao, and Dongsheng Li. 2021. Graph Pooling via Coarsened Graph Infomax. In SIGIR. 2177--2181.
[35]
T Mitchell Roddenberry, Nicholas Glaze, and Santiago Segarra. 2021. Principled Simplicial Neural Networks for Trajectory Prediction. In ICML. 9020--9029.
[36]
T Mitchell Roddenberry, Michael T Schaub, and Mustafa Hajij. 2022. Signal Processing on Cell Complexes. In ICASSP. 8852--8856.
[37]
William E Roth. 1934. On Direct Product Matrices. Bull. Amer. Math. Soc. 40, 6 (1934), 461--468.
[38]
Maciej Rybinski, Liam Watts, and Sarvnaz Karimi. 2022. A2A-API: A Prototype for Biomedical Information Retrieval Research and Benchmarking. In SIGIR. 3318--3322.
[39]
Michael T Schaub, Austin R Benson, Paul Horn, Gabor Lippner, and Ali Jadbabaie. 2020. Random Walks on Simplicial Complexes and the Normalized Hodge 1-Laplacian. SIAM Rev. 62, 2 (2020), 353--391.
[40]
Nino Shervashidze, Pascal Schweitzer, Erik Jan Van Leeuwen, Kurt Mehlhorn, and Karsten M Borgwardt. 2011. Weisfeiler-Lehman Graph Kernels. Journal of Machine Learning Research 12, 9 (2011).
[41]
Petar Veli?kovi?, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li, and Yoshua Bengio. 2018. Graph Attention Networks. In ICLR.
[42]
Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural Deep Network Embedding. In KDD. 1225--1234.
[43]
Yaqing Wang, Song Wang, Yanyan Li, and Dejing Dou. 2022. Recognizing Medical Search Query Intent by Few-shot Learning. In SIGIR. 502--512.
[44]
Boris Weisfeiler and Andrei A Lehman. 1968. A Reduction of a Graph to a Canonical Form and an Algebra Arising During this Reduction. Nauchno-Technicheskaya Informatsia 2, 9 (1968), 12--16.
[45]
Adam C Wilkerson, Terrence J Moore, Ananthram Swami, and Hamid Krim. 2013. Simplifying The Homology of Networks via Strong Collapses. In ICASSP. 5258--5262.
[46]
Le Wu, Yonghui Yang, Lei Chen, Defu Lian, Richang Hong, and Meng Wang. 2020. Learning to Transfer Graph Embeddings for Inductive Graph Based Recommendation. In SIGIR. 1211--1220.
[47]
Wei Wu, Bin Li, Ling Chen, Junbin Gao, and Chengqi Zhang. 2022. A Review for Weighted MinHash Algorithms. IEEE Transactions on Knowledge and Data Engineering 34, 6 (2022), 2553--2573.
[48]
Wei Wu, Bin Li, Ling Chen, and Chengqi Zhang. 2018. Efficient Attributed Network Embedding via Recursive Randomized Hashing. In IJCAI-18. 2861--2867.
[49]
Wei Wu, Bin Li, Ling Chen, Xingquan Zhu, and Chengqi Zhang. 2018. K-Ary Tree Hashing for Fast Graph Classification. IEEE Transactions on Knowledge and Data Engineering 30, 5 (2018), 936--949.
[50]
Wei Wu, Bin Li, Chuan Luo, and Wolfgang Nejdl. 2021. Hashing-Accelerated Graph Neural Networks for Link Prediction. In WWW. 2910--2920.
[51]
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A Comprehensive Survey on Graph Neural Networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1 (2020), 4--24.
[52]
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How Powerful are Graph Neural Networks?. In ICLR.
[53]
Xifeng Yan and Jiawei Han. 2002. gSpan: Graph-based Substructure Pattern Mining. In ICDM. 721--724.
[54]
Dingqi Yang, Bingqing Qu, Jie Yang, Liang Wang, and Philipe Cudre-Mauroux. 2022. Streaming Graph Embeddings via Incremental Neighborhood Sketching. IEEE Transactions on Knowledge and Data Engineering (2022).
[55]
Maosheng Yang, Elvin Isufi, and Geert Leus. 2022. Simplicial Convolutional Neural Networks. In ICASSP. 8847--8851.

Cited By

View all
  • (2025)Time- and Space-Efficiently Sketching Billion-Scale Attributed NetworksIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.350825637:2(966-978)Online publication date: 1-Feb-2025
  • (2024)WePred: Edge Weight-Guided Contrastive Learning for Bipartite Link PredictionElectronics10.3390/electronics1401002014:1(20)Online publication date: 25-Dec-2024

Index Terms

  1. SCHash: Speedy Simplicial Complex Neural Networks via Randomized Hashing

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
      July 2023
      3567 pages
      ISBN:9781450394086
      DOI:10.1145/3539618
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 18 July 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. graph embedding
      2. graph neural networks
      3. hodge laplacian
      4. locality sensitive hashing
      5. simplicial complex

      Qualifiers

      • Research-article

      Conference

      SIGIR '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 792 of 3,983 submissions, 20%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)95
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 02 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Time- and Space-Efficiently Sketching Billion-Scale Attributed NetworksIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.350825637:2(966-978)Online publication date: 1-Feb-2025
      • (2024)WePred: Edge Weight-Guided Contrastive Learning for Bipartite Link PredictionElectronics10.3390/electronics1401002014:1(20)Online publication date: 25-Dec-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media