Skip to main content
SpringerLink
Log in
Book cover

China National Conference on Chinese Computational Linguistics

International Symposium on Natural Language Processing Based on Naturally Annotated Big Data

CCL 2015, NLP-NABD 2015: Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data pp 240–249Cite as

A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing

  • Conference paper
  • First Online:

  • 7119 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9427))

Abstract

Bilingual dependency parsing aims to improve parsing performance with the help of bilingual information. While previous work have shown improvements on either or both sides, most of them mainly focus on designing complicated features and rely on golden translations during training and testing. In this paper, we propose a simple yet effective translation constrained reranking model to improve Chinese dependency parsing. The reranking model is trained using a max-margin neural network without any manually designed features. Instead of using golden translations for training and testing, we relax the restrictions and use sentences generated by a machine translation system, which dramatically extends the scope of our model. Experiments on the translated portion of the Chinese Treebank show that our method outperforms the state-of-the-art monolingual Graph/Transition-based parsers by a large margin (UAS).

This is a preview of subscription content, log in via an institution.

Notes

  1. 1.

    http://stp.lingfil.uu.se/~nivre/research/Penn2Malt.html.

  2. 2.

    http://sourceforge.net/projects/mstparser/.

  3. 3.

    http://www.statmt.org/moses/giza/GIZA++.html.

  4. 4.

    http://code.google.com/p/word2vec/.

References

  1. Yamada, H., Matsumoto, Y.: Statistical dependency parsing analysis with support vector machines. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003)

    Google Scholar 

  2. Nirve, J.: An efficient algorithm for projective dependency parsing. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003)

    Google Scholar 

  3. McDonald, R., Grammer, K., Peereira, F.: Online large-margin training of dependency parsers. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pp. 91–98. Association for Computational Linguistics (2005)

    Google Scholar 

  4. Smith, D.A., Smith, N.A.: Bilingual parsing with factored estimation: using english to parse Korean. In: Proceedings of EMNLP (2004)

    Google Scholar 

  5. Burkett, D., Klein, D.: Two languages are better than one (for syntactic paring). In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 877–886. Association for Computational Linguistics (2008)

    Google Scholar 

  6. Huang, L., Jiang, W., Liu, Q.: Bilingually-constrained (monolingual) shift-reduce parsing. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, vol. 3. Association for Computational Linguistics, pp. 1222–1231 (2009)

    Google Scholar 

  7. Chen, W., Kazama, J., Torisawa, K.: Bitext dependency parsing with bilingual subtree constraints. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 21–29. Association for Computational Linguistics (2010)

    Google Scholar 

  8. Socher, R., Bauer, J., Manning, C.D., Ng, A.Y.: Parsing with compositional vector grammars. In: Proceedings of ACL (2013)

    Google Scholar 

  9. Pei, W., Ge, T., Baobao, C.: Max-margin tensor neural network for Chinese word segmentation. In: proceedings of ACL (2014)

    Google Scholar 

  10. Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12, 2121–2159 (2011)

    MathSciNet  MATH  Google Scholar 

  11. Nianwen, X., Chiou, F.D., Palmer, M.: Building a large-scale annotated Chinese coupus. In: Proceedings of the 19th International Conference on Computational Linguistics, vol. 1, pp. 1–8. Association for Computational Linguistics (2002)

    Google Scholar 

  12. Bies, A., Palmer, M., Mott, J., Warner, C.: English Chinese translation treebank v1.0. LDC2007T02 (2007)

    Google Scholar 

  13. Huang, L., Sagae, K.: Dynamic programming for linear-time incremental parsing. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1077–1086. Association for Computational Linguistics (2010)

    Google Scholar 

  14. Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O.: Alexandra constantin, and evan herbst. In: Moses: Open Source Toolkit for Statistical Machine Translation. Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pp. 177–180. Association for Computational Linguistics (2007)

    Google Scholar 

  15. Graff, D., Chen, K.: Chinese Gigaword. LDC2003T09 (2003)

    Google Scholar 

  16. Graff, D., Cieri, C.: English Gigaword. LDC2003T05 (2003)

    Google Scholar 

  17. van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 85 (2008)

    MATH  Google Scholar 

  18. Chen, D., Manning, C.D.: A fast and accurate dependency parser using neural networks. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 740–750 (2014)

    Google Scholar 

Download references

Acknowledgments

This work is supported by National Key Basic Research Program of China (2014CB340504) and National Natural Science Foundation of China (61273318).

Author information

Authors and Affiliations

  1. Key Laboratory of Computational Linguistics, Ministry of Education School of Electronics Engineering and Computer Science, Peking University Collaborative Innovation Center for Language Ability, Xuzhou, 221009, China

    Miaohong Chen, Baobao Chang & Yang Liu

Authors
  1. Miaohong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Baobao Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Baobao Chang .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Maosong Sun

  2. Tsinghua University, Beijing, China

    Zhiyuan Liu

  3. Soochow University, Suzhou, Jiangsu, China

    Min Zhang

  4. Tsinghua University, Beijing, China

    Yang Liu

Rights and permissions

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (http://creativecommons.org/licenses/by-nc/2.5/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Chen, M., Chang, B., Liu, Y. (2015). A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing. In: Sun, M., Liu, Z., Zhang, M., Liu, Y. (eds) Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data. CCL NLP-NABD 2015 2015. Lecture Notes in Computer Science(), vol 9427. Springer, Cham. https://doi.org/10.1007/978-3-319-25816-4_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25816-4_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25815-7

  • Online ISBN: 978-3-319-25816-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation