Skip to main content
SpringerLink
Log in

An End-to-End Structure Aware Graph Convolutional Network for Modeling Multi-relational Data

  • Conference paper
  • First Online:
PRICAI 2019: Trends in Artificial Intelligence (PRICAI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11671))

Included in the following conference series:

  • 2816 Accesses

Abstract

Low-dimensional embeddings of entities and relations in large scale knowledge graphs have been proved extremely beneficial in variety of downstream tasks, e.g. entity classification and knowledge graph completion. Most of existing approaches incorporate both textual information and relation paths of triple facts for knowledge graph representation. However, they ignore rich structural information in a knowledge graph, i.e., connectivity patterns in neighboring entities and relations around a given entity. In this work, we propose a novel knowledge representation model, denoted Structure Aware Graph Convolutional Network (SAGCN), which leverages structural information for modeling the highly multi-relational data characteristic of realistic knowledge graphs. Specifically, we sample multi-hop neighboring entities and relations of a given entity as its local graph, which depicts the neighborhood topology structure. To encode features from the local graph, we introduce localized graph convolutions as a neighborhood structure encoder to generate embeddings. We further design distinct decoders for entity classification and knowledge graph completion. The proposed approach are evaluated on three public datasets and substantially outperforms state-of-the-arts.

Granted by National Key Research and Development Program of China (No. 2017YFD0700102).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bollacker, K.D., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of SIGMOD, pp. 1247–1250, June 2008

    Google Scholar 

  2. Bordes, A., Chopra, S., Weston, J.: Question answering with subgraph embeddings. In: Proceedings of EMNLP, pp. 615–620, October 2014

    Google Scholar 

  3. Bordes, A., Usunier, N., Garciaduran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of NIPs, pp. 2787–2795, December 2013

    Google Scholar 

  4. Bruna, J., Zaremba, W., Szlam, A., Lecun, Y.: Spectral networks and locally connected networks on graphs. In: Proceedings of ICLR, April 2014

    Google Scholar 

  5. Das, R., Neelakantan, A., Belanger, D., Mccallum, A.: Chains of reasoning over entities, relations, and text using recurrent neural networks. In: Proceedings of EACL, vol. 1, pp. 132–141, April 2017

    Google Scholar 

  6. De Kleer, J.: Building expert systems. Artif. Intell. 25(1), 105–107 (1985)

    Article  Google Scholar 

  7. Dettmers, T., Pasquale, M., Pontus, S., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: Proceedings of AAAI, pp. 1811–1818, February 2018

    Google Scholar 

  8. Duvenaud, D.K., et al.: Convolutional networks on graphs for learning molecular fingerprints. In: Proceedings of NIPs, pp. 2224–2232, December 2015

    Google Scholar 

  9. Garciaduran, A., Bordes, A., Usunier, N.: Composing relationships with translations. In: Proceedings of EMNLP, pp. 286–290, October 2015

    Google Scholar 

  10. Grover, A., Leskovec, J.: node2vec: scalable feature learning for networks. In: Proceedings of SIGKDD, pp. 855–864, August 2016

    Google Scholar 

  11. Guo, S., Wang, Q., Wang, B., Wang, L., Guo, L.: Semantically smooth knowledge graph embedding. In: Proceedings of IJCNLP, vol. 1, pp. 84–94 (2015)

    Google Scholar 

  12. Hamilton, W.L., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of NIPs, pp. 1024–1034, December 2017

    Google Scholar 

  13. Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of ICLR, April 2017

    Google Scholar 

  14. Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., Liu, S.: Modeling relation paths for representation learning of knowledge bases. In: Proceedings of EMNLP, pp. 705–714, October 2015

    Google Scholar 

  15. Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceddings of AAAI, pp. 2181–2187, January 2015

    Google Scholar 

  16. Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  17. Min, B., Grishman, R., Wan, L., Wang, C., Gondek, D.: Distant supervision for relation extraction with an incomplete knowledge base. In: Proceedings of NAACL-HLT, pp. 777–782, June 2013

    Google Scholar 

  18. Mitchell, T., et al.: Never-ending learning. Commun. ACM 61(5), 103–115 (2018)

    Article  Google Scholar 

  19. Neelakantan, A., Chang, M.: Inferring missing entity type instances for knowledge base completion: new dataset and methods. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 515–525 (2015)

    Google Scholar 

  20. Neelakantan, A., Chang, M.: SSP: semantic space projection for knowledge graph embedding with text descriptions. In: Proceedings of AAAI, pp. 3104–3110 (2016)

    Google Scholar 

  21. Neelakantan, A., Roth, B., Mccallum, A.: Compositional vector space models for knowledge base completion. In: Proceedings of IJCNLP, vol. 1, pp. 156–166, July 2015

    Google Scholar 

  22. Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., Phung, D.Q.: A novel embedding model for knowledge base completion based on convolutional neural network. In: Proceedings of NAACL-HLT, vol. 2, pp. 327–333, June 2018

    Google Scholar 

  23. Nguyen, D.Q., Sirts, K., Qu, L., Johnson, M.: Neighborhood mixture model for knowledge base completion. In: Proceedings of SIGNLL, pp. 40–50, August 2016

    Google Scholar 

  24. Nickel, M., Rosasco, L., Poggio, T.: Holographic embeddings of knowledge graphs. In: Proceedings of AAAI, vol. 1, pp. 1955–1961, February 2016

    Google Scholar 

  25. Nickel, M., Tresp, V., Kriegel, H.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of WWW, pp. 271–280, April 2012

    Google Scholar 

  26. Perozzi, B., Alrfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: Proceedings of SIGKDD, pp. 701–710, August 2014

    Google Scholar 

  27. Schlichtkrull, M.S., Kipf, T.N., Bloem, P., Den Berg, R.V., Titov, I., Welling, M.: TransG: a generative model for knowledge graph embedding. In: Proceedings of ACL, vol. 1, pp. 2316–2325, August 2016

    Google Scholar 

  28. Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: Gangemi, A., et al. (eds.) ESWC 2018. LNCS, vol. 10843, pp. 593–607. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93417-4_38

    Chapter  Google Scholar 

  29. Shen, W., Wang, J., Luo, P., Wang, M.: Linking named entities in Tweets with knowledge base via user interest modeling. In: Proceedings of SIGKDD, pp. 68–76, August 2013

    Google Scholar 

  30. Shi, B., Weninger, T.: ProjE: embedding projection for knowledge graph completion. In: Proceedings of AAAI, vol. 1, pp. 2181–2187, February 2017

    Google Scholar 

  31. Socher, R., Chen, D., Manning, C.D., Ng, A.Y.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of NIPs, pp. 926–934, December 2013

    Google Scholar 

  32. Szumlanski, S.R., Gomez, F.: Automatically acquiring a semantic network of related concepts. In: Proceedings of CIKM, pp. 19–28, October 2010

    Google Scholar 

  33. Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: Line: large-scale information network embedding. In: Proceedings of WWW, pp. 1067–1077, May 2015

    Google Scholar 

  34. Toutanova, K., Chen, D.: Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 57–66 (2015)

    Google Scholar 

  35. Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of AAAI, pp. 2071–2080 (2016)

    Google Scholar 

  36. Vrandecic, D., Krotzsch, M.: Wikidata: a free collaborative knowledgebase. Commun. ACM 57(10), 78–85 (2014)

    Article  Google Scholar 

  37. Wang, H., Wang, N., Yeung, D.: Collaborative deep learning for recommender systems. In: Proceedings of SIGKDD, pp. 1235–1244, August 2015

    Google Scholar 

  38. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Proceedings of AAAI, pp. 1112–1119, July 2014

    Google Scholar 

  39. Xie, R., Liu, Z., Jia, J., Luan, H., Sun, M.: Representation learning of knowledge graphs with entity descriptions. In: Proceedings of AAAI, pp. 2659–2665, February 2016

    Google Scholar 

  40. Xie, R., Liu, Z., Jia, J., Luan, H., Sun, M.: Representation learning of knowledge graphs with entity descriptions. In: Proceedings of AAAI, pp. 2659–2665 (2016)

    Google Scholar 

  41. Xiong, W., Yu, M., Chang, S., Guo, X., Wang, W.Y.: One-shot relational learning for knowledge graphs. In: Proceedings of EMNLP, October 2018

    Google Scholar 

  42. Yahya, M., Berberich, K., Elbassuoni, S., Weikum, G.: Robust question answering over the web of linked data. In: Proceedings of CIKM, pp. 1107–1116, October 2013

    Google Scholar 

  43. Yang, B., Yih, W., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: Proceddings of ICLR, May 2015

    Google Scholar 

  44. Zhong, H., Zhang, J., Wang, Z., Wan, H., Chen, Z.: Aligning knowledge and text embeddings by entity descriptions. In: Proceedings of EMNLP, pp. 267–272, September 2015

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Zhejiang University, Hangzhou, China

    Binling Nie, Shouqian Sun & Dian Yu

Authors
  1. Binling Nie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shouqian Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dian Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Binling Nie .

Editor information

Editors and Affiliations

  1. Department of Computing, Macquarie University, Sydney, NSW, Australia

    Abhaya C. Nayak

  2. RIKEN Center for Integrative Medical Sciences, Yokohama, Japan

    Alok Sharma

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nie, B., Sun, S., Yu, D. (2019). An End-to-End Structure Aware Graph Convolutional Network for Modeling Multi-relational Data. In: Nayak, A., Sharma, A. (eds) PRICAI 2019: Trends in Artificial Intelligence. PRICAI 2019. Lecture Notes in Computer Science(), vol 11671. Springer, Cham. https://doi.org/10.1007/978-3-030-29911-8_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29911-8_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29910-1

  • Online ISBN: 978-3-030-29911-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation