Skip to main content

An Advanced Particle Swarm Optimization Based Feature Selection Method for Tri-script Handwritten Digit Recognition

  • Conference paper
  • First Online:
Computational Intelligence, Communications, and Business Analytics (CICBA 2018)

Abstract

Handwritten digit recognition is a well-studied pattern recognition problem. Most of the techniques, reported in the literature, have been concentrated on designing several feature vectors which represent the digits in a better way. But, at times, such attempt not only increases the dimensionality of extracted feature vector but also suffers from having irrelevant and/or redundant features. To address this, in the present work, a recently introduced Particle Swarm Optimization (PSO) based feature selection method has been applied with suitable modifications. For the course of this experiment, we have confined ourselves to a newly employed feature vector for handwritten digit recognition, namely DAISY feature descriptor. The proposed feature selection method is tested on three handwritten digit databases written in Bangla, Devanagari and Roman scripts. The experimental results show that significant amount of feature dimension is reduced without compromising on recognition accuracy. Comparison of the present feature selection method with two of its ancestors also reveals that the present method outperforms the others.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ha, T.M., Bunke, H.: Off-line, handwritten numeral recognition by perturbation method. IEEE Trans. Pattern Anal. Mach. Intell. 19(5), 535–539 (1997)

    Article  Google Scholar 

  2. Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S.: Robust license-plate recognition method for passing vehicles under outside environment. IEEE Trans. Veh. Technol. 49(6), 2309–2319 (2000)

    Article  Google Scholar 

  3. Basu, S., Das, N., Sarkar, R., Kundu, M., Nasipuri, M., Basu, D.K.: Recognition of numeric postal codes from multi-script postal address blocks. In: Chaudhury, S., Mitra, S., Murthy, C.A., Sastry, P.S., Pal, S.K. (eds.) PReMI 2009. LNCS, vol. 5909, pp. 381–386. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-11164-8_62

    Chapter  Google Scholar 

  4. Plamondon, R., Srihari, S.N.: Online and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 63–84 (2000)

    Article  Google Scholar 

  5. Chatterjee, A., Malakar, S., Sarkar, R., Nasipuri, M.: Handwritten digit recognition using daisy descriptor: a study. In: Proceedings of Fifth International Conference of Emerging Applications of Information Technology (EAIT). IEEE (2018)

    Google Scholar 

  6. Karthik, S., Murthy, K.S.: Handwritten Kannada numerals recognition using histogram of oriented gradient descriptors and support vector machines. In: Satapathy, S., Govardhan, A., Raju, K., Mandal, J. (eds.) Emerging ICT for Bridging the Future - Proceedings of the 49th Annual Convention of the Computer Society of India CSI Volume 2. AISC, vol. 338, pp. 51–57. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-13731-5_7

    Chapter  Google Scholar 

  7. Hassan, T., Khan, H.A.: Handwritten Bangla numeral recognition using local binary pattern. In: International Conference on Electrical Engineering and Information Communication Technology (ICEEICT), pp. 1–4. IEEE, May 2015

    Google Scholar 

  8. Singh, P.K., Das, S., Sarkar, R., Nasipuri, M.: Recognition of handwritten Indic script numerals using Mojette Transform. In: Mandal, J., Satapathy, S., Sanyal, M., Bhateja, V. (eds.) Proceedings of the First International Conference on Intelligent Computing and Communication. AISC, vol. 458, pp. 459–466. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-2035-3_47

    Chapter  Google Scholar 

  9. Hassan, A.K.A.: Arabic (Indian) handwritten digits recognition using multi feature and KNN classifier. J. Univ. Babylon Pure Appl. Sci. 26(4), 10–17 (2018)

    Article  Google Scholar 

  10. Bhowmik, S., Sen, S., Hori, N., Sarkar, R., Nasipuri, M.: Handwritten Devanagari numerals recognition using grid based Hausdroff distance. In: Computer, Communication and Electrical Technology: Proceedings of the International Conference on Advancement of Computer Communication and Electrical Technology (ACCET 2016), West Bengal, India, 21–22 October 2016, p. 15. CRC Press, March 2017

    Chapter  Google Scholar 

  11. Dash, K.S., Puhan, N.B., Panda, G.: Unconstrained handwritten digit recognition using perceptual shape primitives. Pattern Anal. Appl. 21(2), 413–436 (2016)

    Article  MathSciNet  Google Scholar 

  12. Cireşan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big multilayer perceptrons for digit recognition. In: Montavon, G., Orr, G.B., Müller, K.-R. (eds.) Neural Networks: Tricks of the Trade. LNCS, vol. 7700, pp. 581–598. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-35289-8_31

    Chapter  Google Scholar 

  13. Naz, S., Umar, A.I., Ahmad, R., Siddiqi, I., Ahmed, S.B., Razzak, M.I., Shafait, F.: Urdu Nastaliq recognition using convolutional–recursive deep learning. Neurocomputing 243, 80–87 (2017)

    Article  Google Scholar 

  14. Ahmed, M., Akhand, M.A.H., Rahman, M.H.: Handwritten Bangla numeral recognition using deep long short term memory. In: 6th International Conference on Information and Communication Technology for the Muslim World (ICT4M), pp. 310–315. IEEE, November 2016

    Google Scholar 

  15. Singh, P.K., Sarkar, R., Nasipuri, M.: Correlation-based classifier combination in the field of pattern recognition. Comput. Intell. 34(3), 839–874 (2017)

    Article  MathSciNet  Google Scholar 

  16. Cruz, R.M., Cavalcanti, G.D., Ren, T.I.: Handwritten digit recognition using multiple feature extraction techniques and classifier ensemble. In: 17th International Conference on Systems, Signals and Image Processing, pp. 215–218, June 2010

    Google Scholar 

  17. Zhang, P., Bui, T.D., Suen, C.Y.: A novel cascade ensemble classifier system with a high recognition performance on handwritten digits. Pattern Recogn. 40(12), 3415–3429 (2007)

    Article  Google Scholar 

  18. Ghosh, M., Malakar, S., Bhowmik, S., Sarkar, R., Nasipuri, M.: Memetic algorithm based feature selection for handwritten city name recognition. In: Mandal, J.K., Dutta, P., Mukhopadhyay, S. (eds.) CICBA 2017. CCIS, vol. 776, pp. 599–613. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-6430-2_47

    Chapter  Google Scholar 

  19. Ghosh, M., Guha, R., Mondal, R., Singh, P.K., Sarkar, R., Nasipuri, M.: Feature selection using histogram-based multi-objective GA for handwritten Devanagari numeral recognition. In: Bhateja, V., Coello Coello, C.A., Satapathy, S.C., Pattnaik, P.K. (eds.) Intelligent Engineering Informatics. AISC, vol. 695, pp. 471–479. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-7566-7_46

    Chapter  Google Scholar 

  20. Chouaib, H., Cloppet, F., Vincent, N.: Fast feature selection for handwritten digit recognition. In: International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 485–490. IEEE, September 2012

    Google Scholar 

  21. Seijas, L.M., Carneiro, R.F., Santana, C.J., Soares, L.S., Bezerra, S.G., Bastos-Filho, C.J.: Metaheuristics for feature selection in handwritten digit recognition. In: Latin America Congress on Computational Intelligence (LA-CCI), pp. 1–6. IEEE, October 2015

    Google Scholar 

  22. Ghosh, M., Malakar, S., Bhowmik, S., Sarkar, R., Nasipuri, M.: Feature selection for handwritten word recognition using memetic algorithm. In: Mandal, J.K., Dutta, P., Mukhopadhyay, S. (eds.) Advances in Intelligent Computing. SCI, vol. 687, pp. 103–124. Springer, Singapore (2019). https://doi.org/10.1007/978-981-10-8974-9_6

    Chapter  Google Scholar 

  23. Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, MHS 1995, pp. 39–43. IEEE, October 1995

    Google Scholar 

  24. Kennedy, J., Eberhart, R.C.: A discrete binary version of the particle swarm algorithm. In: IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, vol. 5, pp. 4104–4108. IEEE, October 1997

    Google Scholar 

  25. Wei, J., et al.: A BPSO-SVM algorithm based on memory renewal and enhanced mutation mechanisms for feature selection. Appl. Soft Comput. 58, 176–192 (2017)

    Article  Google Scholar 

  26. Dongre, V.J., Mankar, V.H.: Development of comprehensive Devnagari numeral and character database for offline handwritten character recognition. Appl. Comput. Intell. Soft Comput. 2012, 29 (2012)

    Article  Google Scholar 

  27. Diem, M., Fiel, S., Garz, A., Keglevic, M., Kleber, F., Sablatnig, R.: ICDAR 2013 competition on handwritten digit recognition (HDRC 2013). In: 12th International Conference on Document Analysis and Recognition (ICDAR), pp. 1422–1427. IEEE, August 2013

    Google Scholar 

  28. Beale, M.H., Hagan, M.T., Demuth, H.B.: Neural network toolbox™ user’s guide. In: R2012a, The MathWorks, Inc., 3 Apple Hill Drive Natick, MA 01760-2098 (2012). www.mathworks.com

  29. Lin, S.W., Lee, Z.J., Chen, S.C., Tseng, T.Y.: Parameter determination of support vector machine and feature selection using simulated annealing approach. Appl. Soft Comput. 8(4), 1505–1512 (2008)

    Article  Google Scholar 

Download references

Acknowledgments

This work is partially supported by the CMATER research laboratory of the Computer Science and Engineering Department, Jadavpur University, India, and PURSE-II and UPE-II Jadavpur University projects. Ram Sarkar is partially funded by DST grant (EMR/2016/007213).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Suryadipto Sarkar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sarkar, S., Ghosh, M., Chatterjee, A., Malakar, S., Sarkar, R. (2019). An Advanced Particle Swarm Optimization Based Feature Selection Method for Tri-script Handwritten Digit Recognition. In: Mandal, J., Mukhopadhyay, S., Dutta, P., Dasgupta, K. (eds) Computational Intelligence, Communications, and Business Analytics. CICBA 2018. Communications in Computer and Information Science, vol 1030. Springer, Singapore. https://doi.org/10.1007/978-981-13-8578-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-8578-0_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-8577-3

  • Online ISBN: 978-981-13-8578-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics