Skip to main content

Language Translation

  • Chapter
  • First Online:
  • 764 Accesses

Part of the book series: SpringerBriefs in Computer Science ((BRIEFSCOMPUTER))

Abstract

This chapter introduces the machine translation part. Machine translation (or text-to-text translation) is one component of speech translation and is used for translating automatic speech recognition (ASR) output into text-to-speech (TTS) input. This section will also explain about neural machine translation, which is the most major translation methodology in recent years.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    There is another RNN unit called the gated recurrent unit (GRU). Also, there are several versions of LSTM, which are slightly different from each other.

  2. 2.

    In statistical machine translation, 3- to 5-gram language models are commonly used.

  3. 3.

    When LSTM is used as a RNN unit, it is sometimes called “bi-directional LSTM” or “bi-LSTM.”

  4. 4.

    In contrast to Fig. 4.1, ‘the’ was eliminated.

References

  1. Koehn, P.: Statistical Machine Translation. Cambridge University Press (2010)

    Google Scholar 

  2. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  3. Mikolov, T., Yih, W.-T., Zweig, G.: Linguistic regularities in continuous space word representations. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT 2013), Atlanta, Georgia, USA (2013)

    Google Scholar 

  4. Mikolov, T., Karafiát, M., Burget, L., Černocký, J., Khudanpur, S.: Recurrent neural network based language model. In: Interspeech ’10 Proceedings, Makuhari, Japan (2010)

    Google Scholar 

  5. Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Proceedings of advances in neural information processing systems 27 (NIPS 2014) (2014)

    Google Scholar 

  6. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations (ICLR 2015) (2015)

    Google Scholar 

  7. Luong, T., Pham, H.,D. Manning, C.D.: Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP-2015), Lisbon, Portugal (2015)

    Google Scholar 

  8. Liu, L., Utiyama, M., Finch, A., Sumita, E.: Agreement on target-bidirectional neural machine translation. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT 2016), San Diego, California, USA (2016)

    Google Scholar 

  9. Imamura, K., Sumita, E.: Ensemble and reranking: using multiple Models in the NICT-2 neural machine translation system at WAT2017. In: Proceedings of the 4th Workshop on Asian Translation (WAT2017), Taipei, Taiwan (2017)

    Google Scholar 

  10. Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Machere, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, Ł., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., Dean, J.: Google’s neural machine translation system: bridging the gap between human and machine translation. ArXiv e-prints, 1609.08144 (2016)

    Google Scholar 

  11. Hansen, L.K., Salamon, P.: Neural network ensembles. IEEE Trans. Pattern Anal. Mach. Intell. 12(10), 993–1001 (1990)

    Article  Google Scholar 

  12. Sennrich, R., Haddow, B., Birch, A.: Neural machine translation of rare words with subword units. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany (2016)

    Google Scholar 

  13. Utiyama, M., Isahara, H.: A comparison of pivot methods for phrase-based statistical machine translation. In: Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, Rochester, New York, USA (2007)

    Google Scholar 

  14. Cohn, T., Lapata, M.: Machine translation by triangulation: making effective use of multi-parallel corpora. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL-2007), Prague, Czech Republic (2007)

    Google Scholar 

  15. Johnson, M., Schuster, M., Le, Q. V., Krikun, M., Wu, Y., Chen, Z., Thorat, N., Viégas, F., Wattenberg, M., Corrado, G., Hughes, M., Dean, J.: Google’s multilingual neural machine translation system: enabling zero-shot translation. ArXiv e-prints, 1611.04558 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenji Imamura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Imamura, K. (2020). Language Translation. In: Kidawara, Y., Sumita, E., Kawai, H. (eds) Speech-to-Speech Translation. SpringerBriefs in Computer Science. Springer, Singapore. https://doi.org/10.1007/978-981-15-0595-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-0595-9_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-0594-2

  • Online ISBN: 978-981-15-0595-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics