Abstract
This chapter introduces the machine translation part. Machine translation (or text-to-text translation) is one component of speech translation and is used for translating automatic speech recognition (ASR) output into text-to-speech (TTS) input. This section will also explain about neural machine translation, which is the most major translation methodology in recent years.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
There is another RNN unit called the gated recurrent unit (GRU). Also, there are several versions of LSTM, which are slightly different from each other.
- 2.
In statistical machine translation, 3- to 5-gram language models are commonly used.
- 3.
When LSTM is used as a RNN unit, it is sometimes called “bi-directional LSTM” or “bi-LSTM.”
- 4.
In contrast to Fig. 4.1, ‘the’ was eliminated.
References
Koehn, P.: Statistical Machine Translation. Cambridge University Press (2010)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Mikolov, T., Yih, W.-T., Zweig, G.: Linguistic regularities in continuous space word representations. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT 2013), Atlanta, Georgia, USA (2013)
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., Khudanpur, S.: Recurrent neural network based language model. In: Interspeech ’10 Proceedings, Makuhari, Japan (2010)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Proceedings of advances in neural information processing systems 27 (NIPS 2014) (2014)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations (ICLR 2015) (2015)
Luong, T., Pham, H.,D. Manning, C.D.: Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP-2015), Lisbon, Portugal (2015)
Liu, L., Utiyama, M., Finch, A., Sumita, E.: Agreement on target-bidirectional neural machine translation. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT 2016), San Diego, California, USA (2016)
Imamura, K., Sumita, E.: Ensemble and reranking: using multiple Models in the NICT-2 neural machine translation system at WAT2017. In: Proceedings of the 4th Workshop on Asian Translation (WAT2017), Taipei, Taiwan (2017)
Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Machere, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, Ł., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., Dean, J.: Google’s neural machine translation system: bridging the gap between human and machine translation. ArXiv e-prints, 1609.08144 (2016)
Hansen, L.K., Salamon, P.: Neural network ensembles. IEEE Trans. Pattern Anal. Mach. Intell. 12(10), 993–1001 (1990)
Sennrich, R., Haddow, B., Birch, A.: Neural machine translation of rare words with subword units. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany (2016)
Utiyama, M., Isahara, H.: A comparison of pivot methods for phrase-based statistical machine translation. In: Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, Rochester, New York, USA (2007)
Cohn, T., Lapata, M.: Machine translation by triangulation: making effective use of multi-parallel corpora. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL-2007), Prague, Czech Republic (2007)
Johnson, M., Schuster, M., Le, Q. V., Krikun, M., Wu, Y., Chen, Z., Thorat, N., Viégas, F., Wattenberg, M., Corrado, G., Hughes, M., Dean, J.: Google’s multilingual neural machine translation system: enabling zero-shot translation. ArXiv e-prints, 1611.04558 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Imamura, K. (2020). Language Translation. In: Kidawara, Y., Sumita, E., Kawai, H. (eds) Speech-to-Speech Translation. SpringerBriefs in Computer Science. Springer, Singapore. https://doi.org/10.1007/978-981-15-0595-9_4
Download citation
DOI: https://doi.org/10.1007/978-981-15-0595-9_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-0594-2
Online ISBN: 978-981-15-0595-9
eBook Packages: Computer ScienceComputer Science (R0)