skip to main content
10.1145/3368756.3369088acmotherconferencesArticle/Chapter ViewAbstractPublication PagessmartcityappConference Proceedingsconference-collections
research-article

Arabic text diacritization: overview and solution

Published:02 October 2019Publication History

ABSTRACT

As recurrent neural networks and statistic models continue to give better results in different fields in science and because Arabic text diacritization is paramount important for many Arabic language processing tasks, we are going in this paper to present an overview of systems handling that problem. Besides, we are going to propose an automatic diacritic restoration system for Arabic texts. We propose here an approach using Long Short Term Memory LSTM network and Alkhalil Morpho Sys2.

References

  1. Abandah, G.A., Graves, A., Al-Shagoor, B., Arabiyat, A., Jamour, F. and Al-Taee, M. 2015. Automatic diacritization of Arabic text using recurrent neural networks. International Journal on Document Analysis and Recognition (IJDAR). 18, 2 (2015), 183--197. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Abed, S., Alshayeji, M. and Sultan, S. 2019. Diacritics Effect on Arabic Speech Recognition. Arabian Journal for Science and Engineering. (2019). Google ScholarGoogle ScholarCross RefCross Ref
  3. Alansary, S. 2017. Alserag: An Automatic Diacritization System for Arabic. Shaalan K., Hassanien A., Tolba F. (eds) Intelligent Natural Language Processing: Trends and Applications. Studies in Computational Intelligence. 523--543.Google ScholarGoogle Scholar
  4. Alnefaie, R. and Azmi, A.M. 2017. Automatic minimal diacritization of Arabic texts. Proceedings of the 3rd International Conference on Arabic Computational Linguistics, ACLing 2017, 5--6 November, Dubai, United Arab Emirates (2017), 169--174.Google ScholarGoogle Scholar
  5. Alqudah, S., Abandah, G. and Arabiyat, A. 2017. Investigating Hybrid Approaches for Arabic Text Diacritization with Recurrent Neural Networks. 2017 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT) (2017).Google ScholarGoogle Scholar
  6. Azmi, A.M. and Almajed, R.S. 2013. A survey of automatic Arabic diacritization techniques. Natural Language Engineering. 21, 3 (2013), 477--495. Google ScholarGoogle ScholarCross RefCross Ref
  7. Bebah, M., Amine, C., Azzeddine, M. and Abdelhak, L. 2014. Hybrid approaches for automatic vowelization of arabic texts. International Journal on Natural Language Computing (IJNLC). 3, 4 (2014), 53--71.Google ScholarGoogle ScholarCross RefCross Ref
  8. Belinkov, Y. and Glass, J. 2015. Arabic Diacritization with Recurrent Neural Networks. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, 17--21 September (2015), 2281--2285.Google ScholarGoogle ScholarCross RefCross Ref
  9. Boudchiche, M., Mazroui, A., Ould, M. and Ould, A. 2017. AlKhalil Morpho Sys 2: A robust Arabic morphosyntactic analyzer. Journal of King Saud University - Computer and Information Sciences. 29, 2 (2017), 141--146. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chennoufi, A. and Mazroui, A. 2016. Morphological, syntactic and diacritics rules for automatic diacritization of Arabic sentences. Journal of King Saud University - Computer and Information Sciences. 29, 2 (2016), 156--163. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Darwish, K., Mubarak, H. and Abdelali, A. 2017. Arabic Diacritization: Stats, Rules, and Hacks. Proceedings of The Third Arabic Natural Language Processing Workshop (WANLP), Valencia, Spain, April 3 (2017), 9--17.Google ScholarGoogle ScholarCross RefCross Ref
  12. Diab, M., Ghoneim, M. and Habash, N. 2007. Arabic Diacritization in the Context of Statistical Machine Translation. Proceedings The 11th Machine Translation Summit (MT-Summit XI), At Copenhagen, Denmark (2007).Google ScholarGoogle Scholar
  13. Elshafei, M., Al-Muhtaseb, H. and Alghamdi, M.M. 2006. Statistical methods for automatic diacritization of Arabic text. Proceedings 18th National computer Conference, Riyadh, March 26--29 (2006), 301--306.Google ScholarGoogle Scholar
  14. Fadel, A., Tuffaha, I., Al-Jawarneh, B. and Al-Ayyoub, M. 2019. Arabic Text Diacritization Using Deep Neural Networks. International conference on Computer Applications & Information Security, At Riyadh, Saudi Arabia (2019), 2--9.Google ScholarGoogle Scholar
  15. Fashwan, A. and Alansary, S. 2016. A Rule Based Method for Adding Case Ending Diacritics for Modern Standard Arabic Texts. proceedings of the 16th Conference on Language Engineering, At Cairo, Egypt (2016).Google ScholarGoogle Scholar
  16. Fashwan, A. and Alansary, S. 2017. SHAKKIL: an automatic diacritization system for modern standard Arabic texts. Proceedings of The Third Arabic Natural Language Processing Workshop (WANLP), Valencia, Spain, April 3 (2017), 84--93.Google ScholarGoogle ScholarCross RefCross Ref
  17. Gal, Y. 2002. An HMM approach to vowel restoration in Arabic and Hebrew. Proceedings of the ACL-02 workshop on Computational approaches to semitic languages, (2002), 1--7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hamed, O. and Zesch, T. 2017. A Survey and Comparative Study of Arabic Diacritization Tools. In Journal for Language Technology and Computational Linguistics JLCL. 32, 1 (2017), 27--47.Google ScholarGoogle ScholarCross RefCross Ref
  19. Metwally, A.S. and Rashwan, M.A. 2016. A Multi-Layered Approach for Arabic Text Diacritization. IEEE International Conference on Cloud Computing and Big Data Analysis (2016), 389--393.Google ScholarGoogle Scholar
  20. Mohamed Attia Mohamed Elaraby Ahmed 2000. A LARGE-SCALE COMPUTATIONAL PROCESSOR OF THE ARABIC MORPHOLOGY, AND APPLICATIONS. Thesis submitted to the of Master of science in Computer engineering.Google ScholarGoogle Scholar
  21. Rashwan, M., Sallab, A. Al, Raafat, H. and Rafea, A. 2014. Automatic Arabic diacritics restoration based on deep nets. Proceedings of the EMNLP 2014 Workshop on Arabic Natural Langauge Processing (ANLP), Doha, Qatar, October 25 (2014), 65--72.Google ScholarGoogle Scholar
  22. Said, A., El-sharqwi, M., Chalabi, A. and Kamal, E. 2013. A Hybrid Approach for Arabic Diacritization. 18th International Conference on Applications of Natural Language to Information Systems, NLDB 2013, Salford, UK, June 19--21, 2013 (2013), 53--64.Google ScholarGoogle Scholar
  23. Shaalan, K. 2010. Rule-based Approach in Arabic Natural Language Processing. International Journal on Information and Communication Technologies. 3, 3 (2010), 11--19.Google ScholarGoogle Scholar
  24. Shaalan, K., Abo Bakr, H.M. and Ziedan, I. 2009. A Arabic Text Diacritization: Overview And Solution hybrid approach for building Arabic diacritizer. Proceedings of the EACL 2009 Workshop on Computational Approaches to Semitic Languages, Athens, Greece, 31 March (2009), 27--35.Google ScholarGoogle Scholar
  25. Shahrour, A., Khalifa, S. and Habash, N. 2015. Improving Arabic Diacritization through Syntactic Analysis. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, SCA2019, October 2-4, 2019, Casablanca, Morocco EMNLP, Lisbon, Portugal, 17--21 September (2015), 1309--1315.Google ScholarGoogle Scholar
  26. Zayyan, A.A., Elmahdy, M., binti Husni, H. and Al Ja'am, J.M. 2016. Automatic Diacritics Restoration for Dialectal Arabic Text. International Journal of Computing and Information Sciences. 12, 2 (2016), 159--165. Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    SCA '19: Proceedings of the 4th International Conference on Smart City Applications
    October 2019
    788 pages
    ISBN:9781450362894
    DOI:10.1145/3368756

    Copyright © 2019 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 2 October 2019

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate183of487submissions,38%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader