Skip to main content
Springer Nature Link
Log in

A Cybersecurity Knowledge Graph Completion Method for Scalable Scenarios

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14120))

  • 1105 Accesses

Abstract

Cybersecurity knowledge graph can well organize and manage cybersecurity data. However, there are still some challenges in the utilization of cybersecurity knowledge graph. Due to the limited cognitive ability and cyberspace exploration ability of human beings, the data in cybersecurity knowledge graph is incomplete. With the continuous changes of cyberspace, there are many unseen entities in the newly added data, and it is difficult to use this kind of data. In order to realize knowledge graph completion in scalable scenarios, we propose a knowledge graph completion method, which uses meta-learning to transfer knowledge from seen entities to unseen entities. It also utilizes a new scoring function to model the relationships between entities from multiple perspectives such as spatial rotation and angle transformation. For improving the robust expression of samples, it uses the correlation matrix and multi-head attention mechanism to explore the relationships between samples. To mitigate the catastrophic forgetting problem, a new self-distillation algorithm is designed to enhance the robustness of the trained model. We construct knowledge graph based on cybersecurity data, and conduct knowledge graph completion experiments. The experiments show that our method is effective in dealing with the problem of cybersecurity knowledge graph completion in scalable scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, Lake Tahoe, Nevada, United States, pp. 2787–2795 (2013)

    Google Scholar 

  2. Chen, M., Zhang, W., Zhang, W., Chen, Q., Chen, H.: Meta relational learning for few-shot link prediction in knowledge graphs. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3–7, 2019. pp. 4216–4225. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/D19-1431

  3. Chen, M., et al.: Meta-knowledge transfer for inductive knowledge graph embedding. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 927–937. SIGIR 2022, Association for Computing Machinery, New York, USA (2022). https://doi.org/10.1145/3477495.3531757

  4. Cui, Z., Yuan, Z., Wu, Y., Sun, X., Yu, K.: Intelligent recommendation for departments based on medical knowledge graph. IEEE Access 11, 25372–25385 (2023)

    Article  Google Scholar 

  5. Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2d knowledge graph embeddings. In: Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), New Orleans, Louisiana, USA. pp. 1811–1818 (2018). https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/17366

  6. Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6–11 August 2017. Proceedings of Machine Learning Research, vol. 70, pp. 1126–1135. PMLR (2017), http://proceedings.mlr.press/v70/finn17a.html

  7. Hou, Z., Yu, B., Tao, D.: Batchformer: Learning to explore sample relationships for robust representation learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18–24, 2022. pp. 7246–7256. IEEE (2022), https://doi.org/10.1109/CVPR52688.2022.00711

  8. Jiao, Y., You, S.: Rescue decision via earthquake disaster knowledge graph reasoning. Multim. Syst. 29(2), 605–614 (2023). https://doi.org/10.1007/s00530-022-01002-9

    Article  Google Scholar 

  9. Kim, K., Ji, B., Yoon, D., Hwang, S.: Self-knowledge distillation with progressive refinement of targets. In: 2021 IEEE/CVF International Conference on Computer Vision, ICCV 2021, Montreal, QC, Canada, October 10–17, 2021. pp. 6547–6556. IEEE (2021), https://doi.org/10.1109/ICCV48922.2021.00650

  10. Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, Texas, USA. pp. 2181–2187 (25–30 January, 2015), http://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/view/9571

  11. Ma, Y., Liu, B., Huang, W., Dan, F.: Knowledge graph based recommendation algorithm for educational resource. In: Proceedings of the 14th International Conference on Education Technology and Computers, ICETC 2022, Barcelona, Spain, October 28–30, 2022. pp. 436–441. ACM (2022), https://doi.org/10.1145/3572549.3572619

  12. Nickel, M., Tresp, V., Kriegel, H.: A three-way model for collective learning on multi-relational data. In: 28th International Conference on Machine Learning, ICML 2011, Bellevue, Washington, USA. pp. 809–816 (28 June - 2 July, 2011), https://icml.cc/2011/papers/438_icmlpaper.pdf

  13. Schlichtkrull, M.S., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: The Semantic Web - 15th International Conference, ESWC 2018, Heraklion, Crete, Greece. Lecture Notes in Computer Science, vol. 10843, pp. 593–607 (2018), https://doi.org/10.1007/978-3-319-93417-4_38

  14. Shen, J., Wang, C., Gong, L., Song, D.: Joint language semantic and structure embedding for knowledge graph completion. In: Proceedings of the 29th International Conference on Computational Linguistics, COLING 2022, Gyeongju, Republic of Korea, October 12–17, 2022. pp. 1965–1978. International Committee on Computational Linguistics (2022), https://aclanthology.org/2022.coling-1.171

  15. Sun, Z., Deng, Z., Nie, J., Tang, J.: Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6–9, 2019. OpenReview.net (2019), https://openreview.net/forum?id=HkgEQnRqYQ

  16. Teru, K.K., Denis, E.G., Hamilton, W.L.: Inductive relation prediction by subgraph reasoning. In: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13–18 July 2020, Virtual Event. Proceedings of Machine Learning Research, vol. 119, pp. 9448–9457. PMLR (2020), http://proceedings.mlr.press/v119/teru20a.html

  17. Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., Bouchard, G.: Complex embeddings for simple link prediction. In: 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA. vol. 48, pp. 2071–2080 (2016), http://proceedings.mlr.press/v48/trouillon16.html

  18. Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., Chang, Y.: Structure-augmented text representation learning for efficient knowledge graph completion. In: WWW ’21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19–23, 2021. pp. 1737–1748. ACM / IW3C2 (2021), https://doi.org/10.1145/3442381.3450043

  19. Wang, H., Wang, D., Xu, X.: Research on the construction method of rice knowledge graph. Autom. Control. Comput. Sci. 56(4), 291–299 (2022). https://doi.org/10.3103/S0146411622040095

    Article  Google Scholar 

  20. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Twenty-Eighth AAAI Conference on Artificial Intelligence, Québec City, Québec, Canada. pp. 1112–1119 (2014), http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8531

  21. Yang, B., Yih, W., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA (2015), http://arxiv.org/abs/1412.6575

  22. Yu, M., et al.: Translation-based embeddings with octonion for knowledge graph completion. Appl. Sci. 12(8), 3935 (2022). https://doi.org/10.3390/app12083935

  23. Zhang, S., Tay, Y., Yao, L., Liu, Q.: Quaternion knowledge graph embeddings. In: Advances in Neural Information Processing Systems, NeurIPS 2019, Vancouver, BC, Canada. pp. 2731–2741 (2019)

    Google Scholar 

  24. Zhang, Z., Cai, J., Zhang, Y., Wang, J.: Learning hierarchy-aware knowledge graph embeddings for link prediction. In: Thirty-Fourth AAAI Conference on Artificial Intelligence. pp. 3065–3072. AAAI Press (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Electronic Engineering, National University of Defense Technology, Hefei, 230037, China

    Peng Wang, Jingju Liu, Qian Yao & Xinli Xiong

  2. Anhui Province Key Laboratory of Cyberspace Security Situation Awareness and Evaluation, Hefei, 230037, China

    Peng Wang, Jingju Liu, Qian Yao & Xinli Xiong

Authors
  1. Peng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jingju Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qian Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xinli Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peng Wang .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Zhi Jin

  2. South China Normal University, Guangzhou, China

    Yuncheng Jiang

  3. Babeș-Bolyai University, Cluj-Napoca, Romania

    Robert Andrei Buchmann

  4. Ulster University, Belfast, UK

    Yaxin Bi

  5. Babeș-Bolyai University, Cluj-Napoca, Romania

    Ana-Maria Ghiran

  6. South China Normal University, Guangzhou, China

    Wenjun Ma

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, P., Liu, J., Yao, Q., Xiong, X. (2023). A Cybersecurity Knowledge Graph Completion Method for Scalable Scenarios. In: Jin, Z., Jiang, Y., Buchmann, R.A., Bi, Y., Ghiran, AM., Ma, W. (eds) Knowledge Science, Engineering and Management. KSEM 2023. Lecture Notes in Computer Science(), vol 14120. Springer, Cham. https://doi.org/10.1007/978-3-031-40292-0_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-40292-0_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-40291-3

  • Online ISBN: 978-3-031-40292-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics