Skip to main content

Statistical and Syllabification Based Model for Nepali Machine Transliteration

  • Conference paper
  • First Online:
Computational Intelligence in Communications and Business Analytics (CICBA 2022)

Abstract

Machine Transliteration is one of the important modules for the development of a correct Machine Translation (MT) system. Machine Translation is the technique of converting sentences in one natural language into another using a machine, whereas Machine Transliteration is the method of converting words in one language into phonetically identical words in another. When Machine Translation is unable to translate the Out-of-Vocabulary (OOV) words, Name Entity words, technical words, abbreviation, etc. then Machine Transliteration transliterates these words phonetically. This paper presents a transliteration system for the English-Nepali language pair using the most widely used statistical method with a linguistic syllabification methodology. A model has been designed based on syllable splitting that splits 19,513 parallel entries which contains person names, place, etc. IRSTLM and GIZA++ are used to build the language model (LM) and translation model (TM) i.e. word alignment respectively over parallel entries. For English-Nepali parallel entries on Syllable based split, an accuracy of 87% has been achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arredondo, I.Y., Ballard, H.: Nepali manual: language and culture (2012)

    Google Scholar 

  2. Balabantaray, R.C., Sahoo, D.: Odia transliteration engine using moses. In: 2014 2nd International Conference on Business and Information Management (ICBIM), pp. 27–29. IEEE (2014)

    Google Scholar 

  3. Rama, T., Gali, K.: Modeling machine transliteration as a phrase based statistical machine translation problem. In: Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009), pp. 124–127 (2009)

    Google Scholar 

  4. Surana, H., Singh, A.K.: A more discerning and adaptable multilingual transliteration mechanism for indian languages. In: Proceedings of the Third International Joint Conference on Natural Language Processing: Volume-I (2008)

    Google Scholar 

  5. Sharma, S., Bora, N., Halder, M.: English-hindi transliteration using statistical machine translation in different notation. Training 20000(297380), 20000 (2012)

    Google Scholar 

  6. Diwakar, S., Goyal, P., Gupta, R.: Transliteration among indian languages using wx notation. In: Proceedings of the Conference on Natural Language Processing 2010, No. CONF, pp. 147–150 (2010)

    Google Scholar 

  7. GIZA++, https://github.com/moses-smt/giza-pp/tree/master/GIZA++. Accessed 21 July 2021

  8. IRSTLM, https://sourceforge.net/projects/irstlm/. Accessed 14 July 2021

  9. Statistical Machine Translation System User Manual and Code Guide, http://www.statmt.goes.org/moses/manual/manual.pdf/. Accessed 07 July 2021

  10. Younes, J., Achour, H., Souissi, E., Ferchichi, A.: Romanized tunisian dialect transliteration using sequence labelling techniques. J. King Saud Univ. Comput. Inf. Sci. (2020)

    Google Scholar 

  11. Sunitha, C., Jaya, A.: A phoneme based model for english to malayalam transliteration. In: International Confernce on Innovation Information in Computing Technologies, pp. 1–4. IEEE (2015)

    Google Scholar 

  12. Jia, Y., Zhu, D., Yu, S.: A noisy channel model for grapheme-based machine transliteration. In: Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009), pp. 88–91 (2009)

    Google Scholar 

  13. Och, F.J., Ney, H.: A systematic comparison of various statistical alignment models. Comput. Linguistics, 29(1), 19–51 (2003)

    Google Scholar 

  14. Koehn, P., et al.: Moses: open source toolkit for statistical machine translation. ACL, 45, 177–180 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amit Kumar Roy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Roy, A.K., Paul, A., Purkayastha, B.S. (2022). Statistical and Syllabification Based Model for Nepali Machine Transliteration. In: Mukhopadhyay, S., Sarkar, S., Dutta, P., Mandal, J.K., Roy, S. (eds) Computational Intelligence in Communications and Business Analytics. CICBA 2022. Communications in Computer and Information Science, vol 1579. Springer, Cham. https://doi.org/10.1007/978-3-031-10766-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-10766-5_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-10765-8

  • Online ISBN: 978-3-031-10766-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics