Cited By
View all- Yuan HSun QFu XJi CLi JChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Dynamic Graph Information BottleneckProceedings of the ACM Web Conference 202410.1145/3589334.3645411(469-480)Online publication date: 13-May-2024
Where to Find Fascinating Inter-Graph Supervision: Imbalanced Graph Classification with Kernel Information Bottleneck
Authors: 
Hui Tang, Xun LiangAuthors Info & Claims
Hui Tang, Xun LiangAuthors Info & ClaimsPages 3240 - 3249
Abstract
Imbalanced graph classification is ubiquitous yet challenging in many real-world applications. Existing methods typically follow the same convention of treating graph instances as discrete individuals and exploit graph neural networks (GNNs) to predict graph labels. Despite their success, they only propagate intra-graph information within a single graph while disregarding extra supervision globally derived from other graphs. In fact, the inter-graph learning plays a vital role in providing more supervision for minority graphs. However, it is disadvantageous to accurately derive reliable inter-graph supervision because the redundancy information from majority graphs is introduced to obscure the representations of minority graphs during the propagation process. To tackle this issue, we propose a novel method that integrates the restricted random walk kernel with the global graph information bottleneck (GIB) to improve imbalanced graph classification. Specifically, the restricted random walk kernel is proposed to perform the inter-graph learning with learnable graph filters and produce kernel outputs. To ensure that the redundant information of majority graphs does not plague kernel outputs, we model the entire kernel learning as a Markovian decision process and employ the global GIB manner to optimize it. Extensive experiments on real-world graph benchmark datasets verify the competitive performance of the proposed method.
Supplemental Material
MP4 File
This is the presentation video of ACM MM23 submission "Where to Find Fascinating Inter-Graph Supervision: Imbalanced Graph Classification with Kernel Information Bottleneck".
- Download
- 20.66 MB
References
[1]
Khushnood Abbas, Alireza Abbasi, Shi Dong, Ling Niu, Laihang Yu, Bolun Chen, Shi-Min Cai, and Qambar Hasan. 2021. Application of network link prediction in drug discovery. BMC bioinformatics, Vol. 22, 1 (2021), 1--21.
[2]
Jinheon Baek, Minki Kang, and Sung Ju Hwang. [n.d.]. Accurate Learning of Graph Representations with Graph Multiset Pooling. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net.
[3]
Mohamed Ishmael Belghazi, Aristide Baratin, Sai Rajeshwar, Sherjil Ozair, Yoshua Bengio, Aaron Courville, and Devon Hjelm. 2018. Mutual information neural estimation. In International conference on machine learning. PMLR, 531--540.
[4]
Jonathon Byrd and Zachary Lipton. 2019. What is the effect of importance weighting in deep learning?. In International conference on machine learning. PMLR, 872--881.
[5]
Ziwei Chai, Siqi You, Yang Yang, Shiliang Pu, Jiarong Xu, Haoyang Cai, and Weihao Jiang. 2022. Can Abnormality be Detected by Graph Neural Networks?. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, Lud De Raedt (Ed.). 1945--1951.
[6]
Deli Chen, Yankai Lin, Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, and Xu Sun. 2021. Topology-imbalance learning for semi-supervised node classification. Advances in Neural Information Processing Systems, Vol. 34 (2021), 29885--29897.
[7]
Junyu Chen, Qianqian Xu, Zhiyong Yang, Xiaochun Cao, and Qingming Huang. 2022. A Unified Framework against Topology and Class Imbalance. In Proceedings of the 30th ACM International Conference on Multimedia. 180--188.
[8]
Xingning Dong, Tian Gan, Xuemeng Song, Jianlong Wu, Yuan Cheng, and Liqiang Nie. 2022. Stacked hybrid-attention and group collaborative learning for unbiased scene graph generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 19427--19436.
[9]
Guodong Du, Jia Zhang, Min Jiang, Jinyi Long, Yaojin Lin, Shaozi Li, and Kay Chen Tan. 2021. Graph-based class-imbalance learning with label enhancement. IEEE Transactions on Neural Networks and Learning Systems (2021).
[10]
Aosong Feng, Chenyu You, Shiqiang Wang, and Leandros Tassiulas. 2022. KerGNNs: Interpretable Graph Neural Networks with Graph Kernels. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI. 6614--6622.
[11]
Xiaotian Han, Zhimeng Jiang, Ninghao Liu, and Xia Hu. 2022. G-mixup: Graph data augmentation for graph classification. In International Conference on Machine Learning. PMLR, 8230--8248.
[12]
Junzhong Ji, Hao Jia, Yating Ren, and Minglong Lei. 2023. Supervised Contrastive Learning with Structure Inference for Graph Classification. IEEE Transactions on Network Science and Engineering (2023).
[13]
Linlin Jia, Benoit Gaüzère, and Paul Honeine. 2022. Graph kernels based on linear patterns: Theoretical and experimental comparisons. Expert Systems with Applications, Vol. 189 (2022), 116095.
[14]
Wei Ju, Xiao Luo, Meng Qu, Yifan Wang, and Chong Chen. [n.d.]. TGNN: A Joint Semi-supervised Framework for Graph-level Classification. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23-29 July 2022. 2122--2128.
[15]
Anees Kazi, Shayan Shekarforoush, S Arvind Krishna, Hendrik Burwinkel, Gerome Vivar, Karsten Kortüm, Seyed-Ahmad Ahmadi, Shadi Albarqouni, and Nassir Navab. 2019. InceptionGCN: receptive field aware graph convolutional network for disease prediction. In International Conference on Information Processing in Medical Imaging. Springer, 73--85.
[16]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24--26, 2017.
[17]
Jia Li, Yongfeng Huang, Heng Chang, and Yu Rong. 2022. Semi-Supervised Hierarchical Graph Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
[18]
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. 2017. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision. 2980--2988.
[19]
Xixun Lin, Chuan Zhou, Jia Wu, Hong Yang, Haibo Wang, Yanan Cao, and Bin Wang. 2023. Exploratory Adversarial Attacks on Graph Neural Networks for Semi-Supervised Node Classification. Pattern Recognition, Vol. 133 (2023), 109042.
[20]
Yixin Liu, Zhao Li, Shirui Pan, Chen Gong, Chuan Zhou, and George Karypis. 2021. Anomaly detection on attributed networks via contrastive self-supervised learning. IEEE transactions on neural networks and learning systems, Vol. 33, 6 (2021), 2378--2392.
[21]
Zemin Liu, Qiheng Mao, Chenghao Liu, Yuan Fang, and Jianling Sun. 2022. On Size-Oriented Long-Tailed Graph Classification of Graph Neural Networks. In Proceedings of the ACM Web Conference 2022. 1506--1516.
[22]
Chao Ma, Jing An, Xiang-En Bai, and Han-Qiu Bao. 2022. Attention and Cost-Sensitive Graph Neural Network for Imbalanced Node Classification. In 2022 IEEE International Conference on Networking, Sensing and Control (ICNSC). IEEE, 1--6.
[23]
Xiaoxiao Ma, Jia Wu, Shan Xue, Jian Yang, Chuan Zhou, and Quan Z Sheng. 2021. A comprehensive survey on graph anomaly detection with deep learning. IEEE Transactions on Knowledge and Data Engineering (2021).
[24]
Annamalai Narayanan, Mahinthan Chandramohan, Rajasekar Venkatesan, Lihui Chen, Yang Liu, and Shantanu Jaiswal. 2017. graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005 (2017).
[25]
Giannis Nikolentzos, Giannis Siglidis, and Michalis Vazirgiannis. 2021. Graph kernels: A survey. Journal of Artificial Intelligence Research, Vol. 72 (2021), 943--1027.
[26]
Giannis Nikolentzos and Michalis Vazirgiannis. 2020. Random walk graph neural networks. Advances in Neural Information Processing Systems, Vol. 33 (2020), 16211--16222.
[27]
Liang Qu, Huaisheng Zhu, Ruiqi Zheng, Yuhui Shi, and Hongzhi Yin. 2021. Imgagn: Imbalanced network embedding via generative adversarial graph networks. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 1390--1398.
[28]
Min Shi, Yufei Tang, Xingquan Zhu, David Wilson, and Jianxun Liu. 2020. Multi-class imbalanced graph convolutional network learning. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence (IJCAI-20).
[29]
Qingyun Sun, Jianxin Li, Hao Peng, Jia Wu, Xingcheng Fu, and Cheng Ji. 2022. Graph structure learning with variational information bottleneck. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 4165--4174.
[30]
Jianheng Tang, Jiajin Li, Ziqi Gao, and Jia Li. 2022. Rethinking Graph Neural Networks for Anomaly Detection. In International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA Proceedings of Machine Learning Research), Vol. 162. 21076--21089.
[31]
Hanchen Wang, Defu Lian, Ying Zhang, Lu Qin, and Xuemin Lin. 2020. GoGNN: Graph of Graphs Neural Network for Predicting Structured Entity Interactions. 1317--1323.
[32]
Kefan Wang, Jing An, and Qi Kang. 2022a. Effective-aggregation Graph Convolutional Network for Imbalanced Classification. In 2022 IEEE International Conference on Networking, Sensing and Control (ICNSC). IEEE, 1--5.
[33]
Yu Wang, Yuying Zhao, Neil Shah, and Tyler Derr. 2022b. Imbalanced graph classification via graph-of-graph neural networks. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2067--2076.
[34]
Junran Wu, Shangzhe Li, Jianhao Li, Yicheng Pan, and Ke Xu. [n.d.]. A Simple yet Effective Method for Graph Classification. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23--29 July 2022. 3580--3586.
[35]
Lirong Wu, Jun Xia, Zhangyang Gao, Haitao Lin, Cheng Tan, and Stan Z Li. 2023. GraphMixup: Improving Class-Imbalanced Node Classification by Reinforcement Mixup and Self-supervised Context Prediction. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2022, Grenoble, France, September 19-23, 2022, Proceedings, Part IV. Springer, 519--535.
[36]
Tailin Wu, Hongyu Ren, Pan Li, and Jure Leskovec. 2020. Graph information bottleneck. Advances in Neural Information Processing Systems, Vol. 33 (2020), 20437--20448.
[37]
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How Powerful are Graph Neural Networks?. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019.
[38]
Pinar Yanardag and SVN Vishwanathan. 2015. Deep graph kernels. In Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 1365--1374.
[39]
Kaixiang Yang, Zhiwen Yu, Xin Wen, Wenming Cao, CL Philip Chen, Hau-San Wong, and Jane You. 2019. Hybrid classifier ensemble for imbalanced data. IEEE transactions on neural networks and learning systems, Vol. 31, 4 (2019), 1387--1400.
[40]
Zhenyu Yang, Ge Zhang, Jia Wu, Jian Yang, Quan Z Sheng, Shan Xue, Chuan Zhou, Charu Aggarwal, Hao Peng, Wenbin Hu, et al. 2023. A Comprehensive Survey of Graph-level Learning. arXiv preprint arXiv:2301.05860 (2023).
[41]
Ge Zhang, Zhenyu Yang, Jia Wu, Jian Yang, Shan Xue, Hao Peng, Jianlin Su, Chuan Zhou, Quan Z Sheng, Leman Akoglu, et al. 2022. Dual-discriminative Graph Neural Network for Imbalanced Graph-level Anomaly Detection. In Advances in Neural Information Processing Systems.
[42]
Muhan Zhang, Zhicheng Cui, Marion Neumann, and Yixin Chen. 2018a. An end-to-end deep learning architecture for graph classification. In Proceedings of the AAAI conference on artificial intelligence, Vol. 32.
[43]
Zhen Zhang, Mianzhi Wang, Yijian Xiang, Yan Huang, and Arye Nehorai. 2018b. Retgk: Graph kernels based on return probabilities of random walks. Advances in Neural Information Processing Systems, Vol. 31 (2018).
[44]
Tong Zhao, Tianwen Jiang, Neil Shah, and Meng Jiang. 2021a. A synergistic approach for graph anomaly detection with pattern mining and feature learning. IEEE Transactions on Neural Networks and Learning Systems, Vol. 33, 6 (2021), 2393--2405.
[45]
Tianxiang Zhao, Xiang Zhang, and Suhang Wang. 2021b. Graphsmote: Imbalanced node classification on graphs with graph neural networks. In Proceedings of the 14th ACM international conference on web search and data mining. 833--841.
Index Terms
- Where to Find Fascinating Inter-Graph Supervision: Imbalanced Graph Classification with Kernel Information Bottleneck
Recommendations
When Imbalance Meets Imbalance: Structure-driven Learning for Imbalanced Graph Classification
WWW '24: Proceedings of the ACM Web Conference 2024Graph Neural Networks (GNNs) can learn representative graph-level features to achieve efficient graph classification. But GNNs usually assume an environment where both class and structure distribution are balanced. Although previous works have considered ...
Imbalanced Graph Classification via Graph-of-Graph Neural Networks
CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge ManagementGraph Neural Networks (GNNs) have achieved unprecedented success in identifying categorical labels of graphs. However, most existing graph classification problems with GNNs follow the protocol of balanced data splitting, which misaligns with many real-...
GDM: Dual Mixup for Graph Classification with Limited Supervision
Machine Learning and Knowledge Discovery in Databases: Research TrackAbstractGraph Neural Networks (GNNs) require a large number of labeled graph samples to obtain good performance on the graph classification task. The performance of GNNs degrades significantly as the number of labeled graph samples decreases. To reduce ...
Comments
Information & Contributors
Information
Published In
October 2023
9913 pages
ISBN:9798400701085
DOI:10.1145/3581783
- General Chairs:
- Abdulmotaleb El Saddik,
- Tao Mei,
- Rita Cucchiara,
- Program Chairs:
- Marco Bertini,
- Diana Patricia Tobon Vallejo,
- Pradeep K. Atrey,
- M. Shamim Hossain
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- National Natural Science Foundation of China
- National Social Science Foundation of China
Conference
MM '23
Sponsor:
MM '23: The 31st ACM International Conference on Multimedia
October 29 - November 3, 2023
Ottawa ON, Canada
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 210Total Downloads
- Downloads (Last 12 months)114
- Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
Cited By
View all- Yuan HSun QFu XJi CLi JChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Dynamic Graph Information BottleneckProceedings of the ACM Web Conference 202410.1145/3589334.3645411(469-480)Online publication date: 13-May-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in