Skip to main content
SpringerLink
Log in

Improved water cycle algorithm with probabilistic neural network to solve classification problems

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Classification is achieved through the categorisation of objects into predefined categories or classes, where the categories or classes are created based on a similar set of attributes of the object. This is referred to as supervised learning. Numerous methodologies have been formulated by researchers in order to solve classification problems effectively. These methodologies exhibit an uncomplicated structure and fast training, and are based on artificial intelligence, such as the probabilistic neural network (PNN). In this study, techniques to improve the accurateness of the PNN in solving classification problems have been analysed with the help of the water cycle algorithm (WCA), which is a population-based metaheuristic that imitates the water cycle in the real world. In the recommended solution, near-optimal solutions are created in order to regulate the arbitrary parameter selection of the PNN. In this study, it has also been suggested that the enhanced WCA (E-WCA) can be used to attain a balance between exploitation and exploration, so that premature conjunction and immobility of the population can be avoided. With the help of 11 standard benchmark datasets, the recommended solutions were verified. The results of the experiment substantiated that the WCA and E-WCA are capable of improving the weight parameters of the PNN, thereby imparting improved performance with respect to convergence speed and classification accuracy, compared with the initial PNN classifier.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Andreopoulou, Z., Koliouska, C., Zopounidis, C.: Multicriteria and Clustering: Classification Techniques in Agrifood and Environment. Springer, Cham (2017)

    Google Scholar 

  2. Johnston, K.B., Oluseyi, H.M.: Generation of a supervised classification algorithm for time-series variable stars with an application to the LINEAR dataset. N. Astron. 52, 35–47 (2017)

    Google Scholar 

  3. Zhang, G.P.: Neural networks for classification: a survey. Trans. Syst. Man. Cybern. C 30, 451–462 (2002)

    Google Scholar 

  4. Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. 29, 131–163 (1997)

    MATH  Google Scholar 

  5. Lee, Y.J., Mangasarian, O.L.: SSVM: a smooth support vector machine for classification. Comput. Optim. Appl. 20, 5–22 (2001)

    MathSciNet  MATH  Google Scholar 

  6. Wai-Ho, A., Chan, K.C.C.: Classification with degree of membership: a fuzzy approach. In: Presented at the Proceedings in International Conference on Data Mining, California, USA, 2001

  7. Han, J.K., Kamber, M.: Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers, Inc., San Francisco (2008)

    MATH  Google Scholar 

  8. Alshareef, A.M., Bakar, A.A., Hamdan, A.R., Abdullah, S.M.S., Alweshah, M.: A case-based reasoning approach for pattern detection in Malaysia rainfall data. Int. J. Big Data Intell. 2, 285–302 (2015)

    Google Scholar 

  9. Alweshah, M., Rashaideh, H., Hammouri, A.I., Tayyeb, H., Ababneh, M.: Solving time series classification problems using support vector machine and neural network. Int. J. Data Anal. Tech. Strateg. 9(3), 237–247 (2017)

    Google Scholar 

  10. Alweshah, M., Omar, A., Alzubi, J., Alaqeel, S.: Solving attribute reduction problem using wrapper genetic programming. Int. J. Comput. Sci. Netw. Secur. 16, 77–84 (2016)

    Google Scholar 

  11. Wang, L., Wu, C.: A combination of models for financial crisis prediction: integrating probabilistic neural network with back-propagation based on adaptive boosting. Int. J.Comput. Intell. Syst. 10, 507–520 (2017)

    Google Scholar 

  12. Alweshah, M.: Construction biogeography-based optimization algorithm for solving classification problems. In: Neural Computing and Applications, pp. 1–10. Springer, Cham (2018)

  13. Zeinali, Y., Story, B.A.: Competitive probabilistic neural network. Integr. Comput. Aided Eng. 24, 105–118 (2017)

    Google Scholar 

  14. Specht, D.F.: Probabilistic neural networks. Neural Netw. 3, 109–118 (1990)

    Google Scholar 

  15. Hernández-Lobato, J.M., Adams, R.: Probabilistic backpropagation for scalable learning of Bayesian neural networks. In: ICML, 2015, pp. 1861–1869.

  16. Melhem, L.B., Azmi, M.S., Muda, A.K., Bani-Melhim, N.J., Alweshah, M.: Text line segmentation of Al-Quran pages using binary representation. Adv. Sci. Lett. 23, 11498–11502 (2017)

    Google Scholar 

  17. Kevric, J., Jukic, S., Subasi, A.: An effective combining classifier approach using tree algorithms for network intrusion detection. Neural Comput. Appl. 1, 1–8 (2016)

    Google Scholar 

  18. Schaffer, J.D., Whitley, D., Eshelman, L.J.: Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: Combinations of Genetic Algorithms and Neural Networks, COGANN-92, 1992, pp. 1–37.

  19. Whitley, D., Starkweather, T., Bogart, C.: Genetic algorithms and neural networks: optimizing connections and connectivity. Parallel Comput. 14, 347–361 (1990)

    Google Scholar 

  20. Sebt, M., Afshar, M., Alipouri, Y.: Hybridization of genetic algorithm and fully informed particle swarm for solving the multi-mode resource-constrained project scheduling problem. Eng. Optim. 49, 513–530 (2017)

    MathSciNet  Google Scholar 

  21. Kumar, S., Singh, M.P.: Pattern recall analysis of the Hopfield neural network with a genetic algorithm. Comput. Math. Appl. 60, 1049–1057 (2010)

    MathSciNet  MATH  Google Scholar 

  22. Singh, S., Bhambri, P., Gill, J.: Time series based temperature prediction using back propagation with genetic algorithm technique. Int. J. Comput. Sci. Issues 8, 28–32 (2011)

    Google Scholar 

  23. Singh, S., Gill, J.: Temporal weather prediction using back propagation based genetic algorithm technique. Int. J. Intell. Syst. Appl. 6, 55–61 (2014)

    Google Scholar 

  24. Huang, H.-X., Li, J.-C., Xiao, C.-L.: A proposed iteration optimization approach integrating backpropagation neural network with genetic algorithm. Expert Syst. Appl. 42, 146–155 (2015)

    Google Scholar 

  25. Chanda, S., Gupta, S., Pratihar, D.K.: A combined neural network and genetic algorithm based approach for optimally designed femoral implant having improved primary stability. Appl. Soft Comput. 38, 296–307 (2016)

    Google Scholar 

  26. Will, A.L.E.: Improvement of a hybrid evolutionary model of genetic algorithms and artificial neural networks. Bol. Técn. 54, 777–780 (2017)

    Google Scholar 

  27. Dragoi, E.-N., Curteanu, S., Leon, F., Galaction, A.-I., Cascaval, D.: Modeling of oxygen mass transfer in the presence of oxygen-vectors using neural networks developed by differential evolution algorithm. Eng. Appl. Artif. Intell. 24, 1214–1226 (2011)

    Google Scholar 

  28. Saleh, A.Y., Shamsuddin, S.M., Hamed, H.N.A.: A hybrid differential evolution algorithm for parameter tuning of evolving spiking neural network. Int. J. Comput. Vis. Robot. 7, 20–34 (2017)

    Google Scholar 

  29. Desell, T., Clachar, S., Higgins, J., Wild, B.: Evolving deep recurrent neural networks using ant colony optimization. In: European Conference on Evolutionary Computation in Combinatorial Optimization, 2015, pp. 86–98

  30. Mavrovouniotis, M., Yang, S.: Training neural networks with ant colony optimization algorithms for pattern classification. Soft Comput. 19, 1511–1522 (2015)

    Google Scholar 

  31. Geng, Y., Zhang, L., Sun, Y., Zhang, Y., Yang, N., Wu, J.: Research on ant colony algorithm optimization neural network weights blind equalization algorithm. Int. J. Secur. Appl. 10, 95–104 (2016)

    Google Scholar 

  32. Lie, F., Kuo, H.-F.: Constructing freeform source through the combination of neural network and binary ant colony optimization. In: SPIE Advanced Lithography, 2017, pp. 101471M–101471M-9

  33. Bin, Z.Y., Zhong, L.L., Ming, Z.Y.: Notice of Retraction Study on network flow prediction model based on particle swarm optimization algorithm and RBF neural network. In: 2010 3rd IEEE International Conference on Computer Science and Information Technology (ICCSIT), 2010, pp. 302–306

  34. Yaghini, M., Khoshraftar, M.M., Fallahi, M.: A hybrid algorithm for artificial neural network training. Eng. Appl. Artif. Intell. 26, 293–301 (2013)

    Google Scholar 

  35. Taormina, R., Chau, K.-W.: Neural network river forecasting with multi-objective fully informed particle swarm optimization. J. Hydroinform. 17, 99–113 (2015)

    Google Scholar 

  36. Gordan, B., Armaghani, D.J., Hajihassani, M., Monjezi, M.: Prediction of seismic slope stability through combination of particle swarm optimization and neural network. Eng. Comput. 32, 85–97 (2016)

    Google Scholar 

  37. Ozturk, C., Karaboga, D.: Hybrid artificial bee colony algorithm for neural network training. In: 2011 IEEE Congress of Evolutionary Computation (CEC), 2011, pp. 84–88

  38. Anuar, S., Selamat, A., Sallehuddin, R.: Hybrid artificial neural network with artificial bee colony algorithm for crime classification. In: Computational Intelligence in Information Systems, pp. 31–40. Springer, Cham (2015)

  39. Ebrahimi, E., Monjezi, M., Khalesi, M.R., Armaghani, D.J.: Prediction and optimization of back-break and rock fragmentation using an artificial neural network and a bee colony algorithm. Bull. Eng. Geol. Environ. 75, 27–36 (2016)

    Google Scholar 

  40. Subramaniam, S., Radhakrishnan, M.: Neural network with bee colony optimization for MRI brain cancer image classification. Int. Arab J. Inf. Technol. 13, 118–124 (2016)

    Google Scholar 

  41. Cruz, D.P.F., Maia, R.D., da Silva, L.A., de Castro, L.N.: BeeRBF: a bee-inspired data clustering approach to design RBF neural network classifiers. Neurocomputing 172, 427–437 (2016)

    Google Scholar 

  42. Jafrasteh, B., Fathianpour, N.: A hybrid simultaneous perturbation artificial bee colony and back-propagation algorithm for training a local linear radial basis neural network on ore grade estimation. Neurocomputing 235, 217–227 (2017)

    Google Scholar 

  43. Ahmed, M.H., Hasan, S., Ali, A.: Learning enhancement of radial basis function neural network with harmony search algorithm. Int. J. Adv. Soft Comput. Appl. 7, 78–103 (2015)

    Google Scholar 

  44. Saleh, A.Y., Shamsuddin, S.M., Hamed, H.N.A.: Multi-objective differential evolution of evolving spiking neural networks for classification problems. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, 2015, pp. 351–368

  45. Yadav, N., Ngo, T.T., Yadav, A., Kim, J.H.: Numerical solution of boundary value problems using artificial neural networks and harmony search. In: International Conference on Harmony Search Algorithm, 2017, pp. 112–118

  46. Kawam, A.A., Mansour, N.: Metaheuristic optimization algorithms for training artificial neural networks. Int. J. Comput. Inf. Technol. 1, 156–161 (2012)

    Google Scholar 

  47. Nawi, N.M., Khan, A., Rehman, M., Chiroma, H., Herawan, T.: Weight optimization in recurrent neural networks with hybrid metaheuristic Cuckoo search techniques for data classification. Math. Probl. Eng. 1, 1–12 (2015)

    Google Scholar 

  48. Yasar, M.: Optimization of reservoir operation using cuckoo search algorithm: example of Adiguzel Dam, Denizli, Turkey. Math. Probl. Eng. 1, 1–7 (2016)

    Google Scholar 

  49. Alweshah, M.: Firefly algorithm with artificial neural network for time series problems. Res. J. Appl. Sci. Eng. Technol. 7, 3978–3982 (2014)

    Google Scholar 

  50. Alweshah, M., Abdullah, S.: Hybridizing firefly algorithms with a probabilistic neural network for solving classification problems. Appl. Soft Comput. 35, 513–524 (2015)

    Google Scholar 

  51. Alweshah, M., Hammouri, A.I., Tedmori, S.: Biogeography-based optimisation for data classification problems. Int. J. Data Min. Model. Manag. 9, 142–162 (2017)

    Google Scholar 

  52. Eskandar, H., Sadollah, A., Bahreininejad, A., Hamdi, M.: Water cycle algorithm—a novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput. Struct. 110, 151–166 (2012)

    Google Scholar 

  53. Eskandar, H., Sadollah, A., Bahreininejad, A.: Weight optimization of truss structures using water cycle algorithm. Int. J. Optim. Civ. Eng. 3, 115–129 (2013)

    Google Scholar 

  54. Haddad, O.B., Moravej, M., Loáiciga, H.A.: Application of the water cycle algorithm to the optimal operation of reservoir systems. J. Irrig. Drain. Eng. 141, 401–406 (2014)

    Google Scholar 

  55. Jabbar, A., Zainudin, S.: Water cycle algorithm for attribute reduction problems in rough set theory. J. Theor. Appl. Inf. Technol. 61, 107–117 (2014)

    Google Scholar 

  56. Sadollah, A., Eskandar, H., Kim, J.H.: Water cycle algorithm for solving constrained multi-objective optimization problems. Appl. Soft Comput. 27, 279–298 (2015)

    Google Scholar 

  57. Sadollah, A., Eskandar, H., Bahreininejad, A., Kim, J.H.: Water cycle algorithm with evaporation rate for solving constrained and unconstrained optimization problems. Appl. Soft Comput. 30, 58–71 (2015)

    Google Scholar 

  58. Sadollah, A., Eskandar, H., Bahreininejad, A., Kim, J.H.: Water cycle algorithm for solving multi-objective optimization problems. Soft Comput. 19, 2587–2603 (2015)

    Google Scholar 

  59. Sarvi, M., Avanaki, I.N.: An optimized fuzzy logic controller by water cycle algorithm for power management of stand-alone hybrid green power generation. Energy Convers. Manag. 106, 118–126 (2015)

    Google Scholar 

  60. El-Hameed, M.A., El-Fergany, A.A.: Water cycle algorithm-based load frequency controller for interconnected power systems comprising non-linearity. IET Gener. Transm. Distrib. 10, 3950–3961 (2016)

    Google Scholar 

  61. Khalilpourazari, S., Mohammadi, M.: Optimization of closed-loop supply chain network design: a water cycle algorithm approach. In: 2016 12th International Conference on Industrial Engineering (ICIE), 2016, pp. 41–45

  62. Sadollah, A., Eskandar, H., Lee, H.M., Yoo, D.G., Kim, J.H.: Water cycle algorithm: a detailed standard code. SoftwareX 5, 37–43 (2016)

    Google Scholar 

  63. Heidari, A.A., Abbaspour, R.A., Jordehi, A.R.: An efficient chaotic water cycle algorithm for optimization tasks. Neural Comput. Appl. 28, 57–85 (2017)

    Google Scholar 

  64. Méndez, E., Castillo, O., Soria, J., Sadollah, A.: Fuzzy dynamic adaptation of parameters in the water cycle algorithm. In: Nature-Inspired Design of Hybrid Intelligent Systems, pp. 297–311. Springer, Cham (2017)

  65. Moradi, M., Sadollah, A., Eskandar, H., Eskandar, H.: The application of water cycle algorithm to portfolio selection. Econ. Res. Ekon. Istraž. 30, 1–23 (2017)

    Google Scholar 

  66. Pahnehkolaei, S.M.A., Alfi, A., Sadollah, A., Kim, J.H.: Gradient-based Water Cycle Algorithm with evaporation rate applied to chaos suppression. Appl. Soft Comput. 53, 420–440 (2017)

    Google Scholar 

  67. Pham, H.N.A., Triantaphyllou, E.: The impact of overfitting and overgeneralization on the classification accuracy in data mining. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 391–431. Springer, New York (2008)

  68. Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45, 427–437 (2009)

    Google Scholar 

  69. Gorunescu, F.: Data Mining: Concepts, Models and Techniques. Springer, Berlin (2011)

    MATH  Google Scholar 

  70. Rutkowski, L., Cpalka, K.: Flexible neuro-fuzzy systems. Neural Netw. 14, 554–574 (2003)

    Google Scholar 

  71. Zarndt, F.: A comprehensive case study: an examination of machine learning and connectionist algorithms. PhD, Department of Computer Science, Brigham Young University (1995)

  72. Ene, M.: Neural network-based approach to discriminate healthy people from those with Parkinson’s disease. Ann. Univ. Craiova Math. Comput. Sci. Ser. 35, 112–116 (2008)

    MathSciNet  MATH  Google Scholar 

  73. Kurgan, L.A., Cios, K.J., Tadeusiewicz, R., Ogiela, M., Goodenday, L.S.: Knowledge discovery approach to automated cardiac SPECT diagnosis. Artif. Intell. Med. 23, 149–169 (2001)

    Google Scholar 

  74. Pham, H.N.A., Triantaphyllou, E.: A meta-heuristic approach for improving the accuracy in some classification algorithms. Comput. Oper. Res. 38, 174–189 (2011)

    MathSciNet  MATH  Google Scholar 

  75. Salar, H., Farrokhi, F.: Improving genetic algorithm performance in multi-classification using simplex method. In: Presented at the First International Conference on Integrated Intelligent Computing (ICIIC), 2010

  76. Pham, H.N.A., Triantaphyllou, E.: The impact of overfitting and overgeneralization on the classification accuracy in data mining. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 391–431. Springer, New York (2008)

Download references

Author information

Authors and Affiliations

  1. Al-Balqa Applied University, Al-Salt, Jordan

    Mohammed Alweshah, Maria Al-Sendah, Osama M. Dorgham & Ammar Al-Momani

  2. Princess Sumaya University for Technology, Amman, Jordan

    Sara Tedmori

Authors
  1. Mohammed Alweshah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Al-Sendah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Osama M. Dorgham
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ammar Al-Momani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sara Tedmori
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Alweshah.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alweshah, M., Al-Sendah, M., Dorgham, O.M. et al. Improved water cycle algorithm with probabilistic neural network to solve classification problems. Cluster Comput 23, 2703–2718 (2020). https://doi.org/10.1007/s10586-019-03038-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-019-03038-5

Keywords

Search

Navigation