Skip to main content

A Review of the Development and Application of Natural Language Processing

  • Conference paper
  • First Online:
Genetic and Evolutionary Computing (ICGEC 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1107))

Included in the following conference series:

Abstract

With the development of convolutional neural networks and deep learning and a series of very significant breakthroughs in computer speech, many new models and methods have been provided for the field of Natural language processing. Natural language processing is a very important branch of artificial intelligence, and its application requirements and relevant fields are also becoming wider and wider. This paper first summarizes the related concepts of Natural language processing; then introduces in detail the development process of Natural language processing; then elaborates on the research progress of the application field of Natural language processing, including lexical analysis, syntactic analysis, machine translation and other fields; finally, the semantic understanding, the problem of low resources and the development direction of other fields are summarized and forecasted.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zong, C.: Statistical NLP, pp. 2–3. Tsinghua University Press, Beijing (2013)

    Google Scholar 

  2. Kaplan, J.: Artificial Intelligence Era, pp. 11–45. Zhejiang. Zhejiang People’s Publishing House, Hangzhou (2016)

    Google Scholar 

  3. Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. Comput. Sci. (2013)

    Google Scholar 

  4. Schuster, M., Palimal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673–2681 (1997)

    Article  Google Scholar 

  5. Cho, K., Merrienboer, B., Gulceher, C., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation (2014). arXiv Preprint arXiv: https://arxiv.org/abs/1406.1078

  6. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  7. Xing, L.: Design of automatic translation generation system in English-Chinese machine translation. Mod. Electron. Technol. (2018)

    Google Scholar 

  8. Giguet, E., Vergne, J.: Syntactic analysis of unrestricted French. In: Proceedings for the International Conference on Recent Advances in Natural Languages Processing (RANLP97), pp. 276–281 (1997)

    Google Scholar 

  9. Katz, B., Marton, G., Borchardt, G., et al.: The START Natural Language Question Answering System [ EB/OL] (2006)

    Google Scholar 

  10. Zheng, Z.: AnswerBus Question Answering System [EB/OL] (2006)

    Google Scholar 

  11. Ittycheriah, A., Roukos, A.: IBM’s statistical question answering system. In: Proceedings of the TREC-11 Conference, pp. 394–401. NIST Special Publication, Gaithersburg (2002)

    Google Scholar 

  12. Cao, C.-G.: NKI-21 century technology hotspot. Comput. World 5(2), 1–3 (1998)

    Google Scholar 

  13. Dong, L., Wei, F., Zhou, M., et al.: Question answering over freebase with multi-column convolutional neural networks. In: Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing, pp. 260–269 (2015)

    Google Scholar 

  14. Qin, B., Liu, T., Li, S.: Multi-document automatic summarization review. Chin. J. Inf. 19(6), 13–20 (2005)

    Google Scholar 

  15. Luhn, H.P.: The automatic creation of literature abstracts. IBM J. Res. Dev. 2(2), 159–165 (1958)

    Article  MathSciNet  Google Scholar 

  16. Edmundson, H.P.: New methods in automatic extracting. J. ACM 16(2), 264–285 (1969)

    Article  Google Scholar 

  17. Conroy, J., O’leary, D.P.: Text summarization via hidden markov models and pivoted qr matrix decomposition. Technical report, In SIGIR (2001)

    Google Scholar 

  18. Osborne, M.: Using maximum entropy for sentence extraction. In: Proceedings of the ACL-Q2 Workshop on Automatic Summarization-Volume4, AS 2002, pp. 1–8 (2002). pales

    Google Scholar 

  19. Liu, Y., Zhong, S.H., Li, W.: Query-oriented multi-document summarization via unsupervised deep learning. In: AAAI’12 Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, pp. 1699–1705. AAAI Press, Palo Alto (2012)

    Google Scholar 

  20. Abadi, M., Agarwal, A., Barham, P., et al.: Tensorflow: Large-scale machine learning on heterogeneous distributed systems (2016). arXiv preprint arXiv:1603.04467

  21. Kalchbrenner, N., Blunson, P.: Recurrent continuous translation models. In: Proceedings of the 2013 Conference on Empirical Methods in NLP, pp. 1700–1709 (2013)

    Google Scholar 

  22. Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, pp. 3104–3112 (2014)

    Google Scholar 

  23. He, W., He, Z., Wu, H., et al.: Improved neural machine translation with SMT features. In: AAAI, pp. 151–157 (2016)

    Google Scholar 

  24. Tang, X.-B., Yan, C.-X.: A sentimental classification model based on SPIPR() principle and support vector machine. Inf. Stud.: Theory Appl. 36(1), 98–103 (2013)

    MathSciNet  Google Scholar 

  25. Manek, A.S., Shenoy, P.D., Mohan, M.C., et al.: Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier. World Wide Web-internet Web Inf. Syst. 20(2), 135–154 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work was funded by the Education and Research Projects of Fujian University of Technology, numbered JXKA18015, GB-M-17-11, and GY-Z15101; and Foundation for Scientific Research of Fujian Education Committee (JAT170371).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei-Wen Guo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guo, WW., Huang, LL., Pan, JS. (2020). A Review of the Development and Application of Natural Language Processing. In: Pan, JS., Lin, JW., Liang, Y., Chu, SC. (eds) Genetic and Evolutionary Computing. ICGEC 2019. Advances in Intelligent Systems and Computing, vol 1107. Springer, Singapore. https://doi.org/10.1007/978-981-15-3308-2_47

Download citation

Publish with us

Policies and ethics