Skip to main content

Advertisement

Log in

Training of neural network for pattern classification using fireworks algorithm

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

The challenge of training the artificial neural networks (ANNs) which is frequently used for classification purpose has been consistently growing over the last few years, this is probably due to the high dimensional and multi-modal nature of the search space. Nature-inspired metaheuristic algorithms have been successfully employed in the process of weight training of such complex continuous optimization problems. In this paper, a recently proposed fireworks algorithm (FWA) is presented for the training of the parameters of the ANNs. FWA is a class of population-based search method which imitates the explosion process of real fireworks at night. In order to investigate the performance of the proposed method, experiments were conducted on seven benchmark problem instance from the UCI machine learning laboratory and the results obtained by the proposed method are compared with those obtained by krill herd algorithm, harmony search algorithm and genetic algorithm. The results of the evaluation showed superiority of the proposed algorithm in both SSE and training CA and had comparative performance in testing CA and thus it can be concluded that FWA could be adopted as one of the new template algorithm for the training of ANNs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abusnaina AA, Abdullah R (2013) Mussels wandering optimization algorithm based training of artificial neural networks for pattern classification. In: Proceedings of the 4th international conference on computing and informatics, ICOCI, pp 78–85

  • Ajith A (2005) Artificial neural networks. In: PH Sydenham, R. Thorn (eds) Handbook of measuring system design

  • Chalup S, Maire F (1999) A study on hill climbing algorithms for neural network training. In: Proceedings of the 1999 Congress on evolutionary computation, 1999. CEC 99, vol 3. IEEE

  • Chen JF, Do QH, Hsieh HN (2015) Training artificial neural networks by a hybrid PSO-CS algorithm. Algorithms 8(2):292–308

    Article  MathSciNet  Google Scholar 

  • Frank A, Asuncion A (2010) UCI machine learning repository. http://archive.ics.uci.edu/ml. University of California, Irvine, CA. School of Information and Computer Science 213

  • Gori M, Tesi A (1992) On the problem of local minima in backpropagation. IEEE Trans Pattern Anal Mach Intell 1:76–86

    Article  Google Scholar 

  • Gudise VG, Venayagamoorthy GK (2003) Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks. In: Swarm intelligence symposium, 2003. SIS’03. Proceedings of the 2003 IEEE. IEEE, pp 110–117

  • He W, Mi G, Tan Y (2013) Parameter optimization of local-concentration model for spam detection by using fireworks algorithm. In: Advances in swarm intelligence. Springer, Berlin, pp 439–450

  • Heaton J (2008) Introduction to neural networks with Java. Heaton Research Inc., Chesterfield

    Google Scholar 

  • Imran AM, Kowsalya M (2014) A new power system reconfiguration scheme for power loss minimization and voltage profile enhancement using fireworks algorithm. Int J Electr Power Energy Syst 62:312–322

    Article  Google Scholar 

  • Karaboga D, Ozturk C (2009) Neural networks training by artificial bee colony algorithm on pattern classification. Neural Netw World 19(3):279

    Google Scholar 

  • Karaboga D, Akay B, Ozturk C (2007) Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In: Modeling decisions for artificial intelligence. Springer, Berlin, pp 318–329

  • Kattan A, Abdullah R, Salam RA (2010) Harmony search based supervised training of artificial neural networks. In: 2010 International conference on intelligent systems, modelling and simulation (ISMS). IEEE, pp 105–110

  • Kowalski PA, Łukasik S (2015) Training neural networks with krill herd algorithm. Neural Process Lett 44(1):5–17

    Article  Google Scholar 

  • Kulluk S, Ozbakir L, Baykasoglu A (2012) Training neural networks with harmony search algorithms for classification problems. Eng Appl Artif Intell 25(1):11–19

    Article  Google Scholar 

  • Lari NS, Abadeh MS (2014) Training artificial neural network by krill-herd algorithm. In: 2014 IEEE 7th joint international information technology and artificial intelligence conference (ITAIC). IEEE, pp 63–67

  • Liu J, Zheng S, Tan Y (2014) Analysis on global convergence and time complexity of fireworks algorithm. In: 2014 IEEE Congress on evolutionary computation (CEC). IEEE, pp 3207–3213

  • Meissner M, Schmuker M, Schneider G (2006) Optimized particle swarm optimization (OPSO) and its application to artificial neural network training. BMC Bioinform 7(1):125

    Article  Google Scholar 

  • Mirjalili S, Hashim SZM, Sardroudi HM (2012) Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm. Appl Math Comput 218(22):11,125–11,137

    MathSciNet  MATH  Google Scholar 

  • Ozturk C, Karaboga D (2011) Hybrid artificial bee colony algorithm for neural network training. In: 2011 IEEE Congress on evolutionary computation (CEC). IEEE, pp 84–88

  • Paliwal M, Kumar UA (2009) Neural networks and statistical techniques: a review of applications. Expert Syst Appl 36(1):2–17

    Article  Google Scholar 

  • Pei Y, Zheng S, Tan Y, Takagi H (2012) An empirical study on influence of approximation approaches on enhancing fireworks algorithm. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 1322–1327

  • Sangeetha K, Babu TS, Rajasekar N (2016) Fireworks algorithm-based maximum power point tracking for uniform irradiation as well as under partial shading condition. In: Artificial intelligence and evolutionary computations in engineering systems. Springer, pp 79–88

  • Schaffer JD, Whitley D, Eshelman LJ (1992) Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: International workshop on combinations of genetic algorithms and neural networks, 1992. COGANN-92. IEEE, pp 1–37

  • Sexton RS, Alidaee B, Dorsey RE, Johnson JD (1998) Global optimization for artificial neural networks: a tabu search application. Eur J Oper Res 106(2):570–584

    Article  MATH  Google Scholar 

  • Sexton RS, Dorsey RE, Johnson JD (1999) Optimization of neural networks: a comparative analysis of the genetic algorithm and simulated annealing. Eur J Oper Res 114(3):589–601

    Article  MATH  Google Scholar 

  • Tan Y (2015) Fireworks algorithm: a novel swarm intelligence optimization method. Springer, Berlin

    Book  MATH  Google Scholar 

  • Tan Y, Zhu Y (2010) Fireworks algorithm for optimization. In: Advances in swarm intelligence. Springer, Berlin, pp 355–364

  • Tan Y, Yu C, Zheng S, Ding K (2013) Introduction to fireworks algorithm. Int J Swarm Intell Res (IJSIR) 4(4):39–70

    Article  Google Scholar 

  • Valian E, Mohanna S, Tavakoli S (2011) Improved cuckoo search algorithm for feedforward neural network training. Int J Artif Intell Appl 2(3):36–43

    Google Scholar 

  • Yu C, Kelley L, Zheng S, Tan Y (2014) Fireworks algorithm with differential mutation for solving the cec 2014 competition problems. In: 2014 IEEE Congress on evolutionary computation (CEC). IEEE, pp 3238–3245

  • Zhang L, Suganthan P (2016) A survey of randomized algorithms for training neural networks. Inf Sci. doi:10.1016/j.ins.2016.01.039

    Google Scholar 

  • Zhang JR, Zhang J, Lok TM, Lyu MR (2007) A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training. Appl Math Comput 185(2):1026–1037

    MATH  Google Scholar 

  • Zhang B, Zhang MX, Zheng YJ (2014) A hybrid biogeography-based optimization and fireworks algorithm. In: 2014 IEEE Congress on evolutionary computation (CEC). IEEE, pp 3200–3206

  • Zheng S, Janecek A, Tan Y (2013) Enhanced fireworks algorithm. In: 2013 IEEE Congress on evolutionary computation (CEC). IEEE, pp 2069–2077

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Asaju La’aro Bolaji.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bolaji, A.L., Ahmad, A.A. & Shola, P.B. Training of neural network for pattern classification using fireworks algorithm. Int J Syst Assur Eng Manag 9, 208–215 (2018). https://doi.org/10.1007/s13198-016-0526-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-016-0526-z

Keywords

Navigation