Skip to main content

Abstract

Knowledge bases are useful resource for many applications, but reasoning new relationships between new entities based on them is difficult because they often lack the knowledge of new relations and entities. In this paper, we introduce the novel Neural Tensor Network (NTN)[1] model to reason new facts based on Chinese knowledge bases. We represent entities as an average of their constituting word or character vectors, which share the statistical strength between entities, such as . The NTN model uses a tensor network to replace a standard neural layer, which strengthen the interaction of two entity vectors in a simple and efficient way. In experiments, we compare the NTN and several other models, the results show that all models’ performance can be improved when word vectors are pre-trained from an unsupervised large corpora and character vectors don’t have this advantage. The NTN model outperforms others and reachs high classification accuracy 91.1% and 89.6% when using pre-trained word vectors and random character vectors, respectively. Therefore, when Chinese word segmentation is a difficult task, initialization with random character vectors is a feasible choice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Socher, R., Chen, D., Manning, C.D., Ng, Y.: Reasoning With Neural Tensor Networks for Knowledge Base Completion. In: Advances in Neural Information Processing Systems 26 (2013)

    Google Scholar 

  2. Mukherjee, T., Pande, V., Kok, S.: Extracting New Facts in Knowledge Bases:-A matrix trifactorization approach. In: ICML Workshop on Structured Learning: Inferring Graphs from Structured and Unstructured Inputs (2013)

    Google Scholar 

  3. Nickel, M., Tresp, V., Chen, Kriegel, H.P.: A Three-Way Model for Collective Learning on Multi-Relational Data. In: Proceedings of the 28th International Conference on Machine Learning (2011)

    Google Scholar 

  4. Nickel, M., Tresp, V.: Logstic Tensor Factorization for Multi-Relational Data. In: Proceedings of the 30th International Conference on Machine Learning (2013)

    Google Scholar 

  5. Huang, E.H., Socher, R., Manning, C.D., Ng, Y.: Improving Word Representations via Global Context and Multiple Word Prototypes. In: Annual Meeting of the Association for Computational Linguistics, ACL (2012)

    Google Scholar 

  6. Bordes, A., Weston, J., Collobert, R., Bengio, Y.: Learning structured embeddings of knowledge bases. In: AAAI (2011)

    Google Scholar 

  7. Jenatton, R., Le Roux, N., Bordes, A., Obozinski, G.: A latent factor model for highly multi-relational data. In: NIPS (2012)

    Google Scholar 

  8. Bordes, A., Glorot, X., Weston, J., Bengio, Y.: Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing. In: AISTATS (2012)

    Google Scholar 

  9. Bowman, S.R.: Can recursive neural tensor networks learn logical reasoning? In: International Conference on Learning Representations (2013)

    Google Scholar 

  10. Deep Learning Tutorials, http://deeplearning.net/tutorial/

  11. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., Bengio, Y.: Theano: A CPU and GPU Math Expression Compiler. In: Proceedings of the Python for Scientific Computing Conference, SciPy (2010)

    Google Scholar 

  12. May, P., Ehrlich, H.-C., Steinke, T.: ZIB Structure Prediction Pipeline: Composing a Complex Biological Workflow Through Web Services. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds.) Euro-Par 2006. LNCS, vol. 4128, pp. 1148–1158. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  13. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1999)

    Google Scholar 

  14. Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: an Open Grid Services Architecture for Distributed Systems Integration. Technical report, Global Grid Forum (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Ji, G., Zhang, Y., Hao, H., Zhao, J. (2014). Reasoning Over Relations Based on Chinese Knowledge Bases. In: Sun, M., Liu, Y., Zhao, J. (eds) Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data. NLP-NABD CCL 2014 2014. Lecture Notes in Computer Science(), vol 8801. Springer, Cham. https://doi.org/10.1007/978-3-319-12277-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12277-9_13

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12276-2

  • Online ISBN: 978-3-319-12277-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics