Skip to main content
Log in

Elitist teaching–learning-based optimization (ETLBO) with higher-order Jordan Pi-sigma neural network: a comparative performance analysis

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

This paper presents the performance analysis of a newly developed elitist teaching–learning-based optimization algorithm applied with an efficient higher-order Jordan Pi-sigma neural network (JPSNN) for real-world data classification. Teaching–learning-based optimization (TLBO) algorithm is a recent metaheuristic, which is inspired through the teaching and learning process of both teacher and learner. As compared to other algorithms, it is efficient and robust due to its non-controlling parameter adjustments feature. Elitist TLBO is an improved version of TLBO with the addition of elitist solutions, which makes it more efficient. During the experiment, first the TLBO and then ETLBO algorithm are applied with only Pi-sigma neural network and its performance has been compared with other methods such as GA and PSO. Then, the ETLBO algorithm is applied with JPSNN and found better results over other methods. The proposed method has been tested with real-world benchmark datasets considered from UCI machine learning repository, and the performance has been compared with all seven approaches along with other HONN to prove the effectiveness of the method. Simulation results and statistical analysis show the superiority in the performance of the proposed approach as well as prove the potentiality over other existing approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Holland JH (1992) Genetic algorithms. Scientific American, New York, pp 66–72

    Google Scholar 

  2. Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading

    MATH  Google Scholar 

  3. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks vol 4, pp 1942–1948

  4. Alatas B, Akın E (2005) FCACO: fuzzy classification rules mining algorithm with ant colony optimization. In: ICNC 2005. Lecture notes in computer science, vol 3612. Springer, Berlin, pp 787–797

  5. Dorigo M, Maziezzo V, Colorni A (1996) The ant system: optimization by a colony of cooperating ants. IEEE Trans Syst Man Cybern B 26(1):29–41

    Article  Google Scholar 

  6. Alatas B (2010) Chaotic bee colony algorithms for global numerical optimization. Expert Syst Appl 37(8):5682–5687

    Article  Google Scholar 

  7. Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471

    Article  MathSciNet  MATH  Google Scholar 

  8. Li XL (2003) New intelligent optimization-artificial fish swarm algorithm. PhD thesis, Zhejiang University, China

  9. Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76:60–70

    Article  Google Scholar 

  10. Yin M, Hu Y, Yang F, Li X, Gu W (2011) A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering. Expert Syst Appl 38(8):9319–9324

    Article  Google Scholar 

  11. Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248

    Article  MATH  Google Scholar 

  12. Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications SAGA 2009. Lecture notes in computer sciences, vol 5792, pp 169–178

  13. Krishnanand KN, Ghose D (2006) Glowworm swarm based optimization algorithm for multimodal functions with collective robotics applications. Multiagent Grid Syst 2(3):209–222

    Article  MATH  Google Scholar 

  14. Wu B, Qian C, Ni W, Fan S (2012) The improvement of glowworm swarm for continuous optimization problems. Expert Syst Appl 39(7):6335–6342

    Article  Google Scholar 

  15. Jamili A, Shafia MA, Tavakkoli-Moghaddam R (2011) A hybridization of simulated annealing and electro magnetism-like mechanism for a periodic job shop scheduling problem. Expert Syst Appl 38(5):5895–5901

    Article  Google Scholar 

  16. Birbil SI, Fang SC (2003) An electromagnetism-like mechanism for global optimization. J Global Optim 25:263–282

    Article  MathSciNet  MATH  Google Scholar 

  17. Xie L, Zeng J, Cui Z (2009) General framework of artificial physics optimization algorithm. In: IEEE nature & biologically inspired computing, pp 1321–1326

  18. Alatas B (2011) Uniform big bang-chaotic big crunch optimization. Commun Nonlinear Sci Numer Simul 16(9):3696–3703

    Article  MATH  Google Scholar 

  19. Erol OK, Eksin I (2006) A new optimization method: big bang-big crunch. Adv Eng Softw 37:106–111

    Article  Google Scholar 

  20. Kaveh A, Laknejadi K (2011) A novel hybrid charge system search and particle swarm optimization method for multi-objective optimization. Expert Syst Appl 38(12):15475–15488

    Article  Google Scholar 

  21. Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213(3–4):267–289

    Article  MATH  Google Scholar 

  22. Sacco WF, de Oliveira CRE (2005) A new stochastic optimization algorithm based on a particle collision metaheuristic. In: 6th world congresses of structural and multidisciplinary optimization

  23. Formato RA (2007) Central force optimization: a new metaheuristic with applications in applied electromagnetics. Prog Electromagn Res PIER 77:425–491

    Article  Google Scholar 

  24. Green RC, Wang L, Alam M (2012) Training neural networks using central force optimization and particle swarm optimization: insights and comparisons. Expert Syst Appl 39(1):555–563

    Article  Google Scholar 

  25. Rao RV, Savsani VJ, Vakharia DP (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43:303–315

    Article  Google Scholar 

  26. Rao RV, Savsani VJ, Vakharia DP (2012) Teaching–learning-based optimization: an optimization method for continuous non-linear large scale problems. Inf Sci 183:1–15

    Article  MathSciNet  Google Scholar 

  27. Rao RV, Vivek P (2013) An improved teaching–learning-based optimization algorithm for solving unconstrained optimization problems. Scientia Iranica D 20(3):710–720

    Google Scholar 

  28. Venkata Rao R, Patel V (2012) An elitist teaching–learning-based optimization algorithm for solving complex constrained optimization problems. Int J Ind Eng Comput 3:535–560

    Google Scholar 

  29. Rao RV, Waghmare GG (2013) A comparative study of a teaching–learning-based optimization algorithm on multi-objective unconstrained and constrained functions. J King Saud Univ Comput Inf Sci. doi:10.1016/j.jksuci.2013.12.004

    Google Scholar 

  30. Rao RV, More KC (2015) Optimal design of the heat pipe using TLBO (teaching–learning-based optimization) algorithm. Energy 80:535–544

    Article  Google Scholar 

  31. Ergun U, Murat K, Adem A, Tayfun D (2014) Estimates of energy consumption in Turkey using neural networks with the teaching–learning-based optimization algorithm. Energy 75:295–303

    Article  Google Scholar 

  32. Wang L, Zou F, Hei X, Yang D, Chen D, Jiang Q (2014) An improved teaching–learning-based optimization with neighborhood search for applications of ANN. Neurocomputing 143:231–247

    Article  Google Scholar 

  33. Basu M (2014) Teaching–learning-based optimization algorithm for multi-area economic dispatch. Energy 68:21–28

    Article  Google Scholar 

  34. Yang Z, Li K, Foley A, Zhang C (2014) A new self-learning TLBO algorithm for RBF neural modelling of batteries in electric vehicles. In: IEEE congress on evolutionary computation (CEC), pp 2685–2691. doi:10.1109/CEC.2014.6900428

  35. Medina MA, Coello Coello CA, Ramirez JM (2013) Reactive power handling by a multi-objective teaching learning optimizer based on decomposition. IEEE Trans Power Syst 28(4):3629–3637. doi:10.1109/TPWRS.2013.2272196

    Article  Google Scholar 

  36. Nayak MR, Nayak CK, Rout PK (2012) Application of multi-objective teaching learning based optimization algorithm to optimal power flow problem. Proc Technol 6:255–264

    Article  Google Scholar 

  37. Toğan V (2012) Design of planar steel frames using teaching-learning based optimization. Eng Struct 34:225–232

    Article  Google Scholar 

  38. Niknam T, Golestaneh F, Sadeghi MS (2012) θ-multiobjective teaching–learning-based optimization for dynamic economic emission dispatch. IEEE Syst J 6(2):341–352. doi:10.1109/JSYST.2012.2183276

    Article  Google Scholar 

  39. Jadhav HT, Chawla D, Roy R (2012) Modified teaching–learning based algorithm for economic load dispatch incorporating wind power. In: 11th international conference on environment and electrical engineering (EEEIC), pp 397–402. doi:10.1109/EEEIC.2012.6221410

  40. Satapathy SC, Naik A, Parvathi K (2012) Teaching learning based optimization for neural networks learning enhancement. Lect Notes Comput Sci 7677:761–769

    Article  Google Scholar 

  41. Zou F, Wang L, Hei X, Chen D, Wang B (2013) Multi-objective optimization using teaching–learning-based optimization algorithm. Eng Appl Artif Intell 26:1291–1300

    Article  Google Scholar 

  42. Kumar RP, Aditi S, Kumar PD (2013) Optimal short-term hydro-thermal scheduling using quasi-oppositional teaching learning based optimization. Eng Appl Artif Intell 26:2516–2524

    Article  Google Scholar 

  43. Mandal B, Roy PK (2013) Optimal reactive power dispatch using quasi-oppositional teaching learning based optimization. Electr Power Energy Syst 53:123–134

    Article  Google Scholar 

  44. García JAM, Mena AJG (2013) Optimal distributed generation location and size using a modified teaching–learning based optimization algorithm. Electr Power Energy Syst 50:65–75

    Article  Google Scholar 

  45. Venkata RR, Kalyankar VD (2013) Parameter optimization of modern machining processes using teaching–learning-based optimization algorithm. Eng Appl Artif Intell 26:524–531

    Article  Google Scholar 

  46. Roy PK (2013) Teaching learning based optimization for short-term hydrothermal scheduling problem considering valve point effect and prohibited discharge constraint. Electr Power Energy Syst 53:10–19

    Article  Google Scholar 

  47. Roy PK, Bhui S (2013) Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem. Electr Power Energy Syst 53(2013):937–948

    Article  Google Scholar 

  48. Singh M, Panigrahi BK, Abhyankar AR (2013) Optimal coordination of directional over-current relays using teaching–learning-based optimization (TLBO) algorithm. Electr Power Energy Syst 50:33–41

    Article  Google Scholar 

  49. Wang K-L, Wang H-B, Yu L-X, Ma X-Y, Xue Y-S (2013) Toward teaching-learning-based optimization algorithm for dealing with real-parameter optimization problems. In: Proceedings of the 2nd international conference on computer science and electronics engineering (ICCSEE 2013), pp 0606–0609

  50. Satapathy SC, Naik A, Parvathi K (2013) Weighted teaching–learning-based optimization for global function optimization. Appl Math 4:429–439

    Article  Google Scholar 

  51. Satapathy SC, Naik A, Parvathi K (2013) A teaching learning based optimization based on orthogonal design for solving global optimization problems. Springer Plus 2:130

    Article  Google Scholar 

  52. Tuo S, Yong L, Zhou T (2013) An improved harmony search based on teaching–learning strategy for unconstrained optimization problems. Math Problems Eng. doi:10.1155/2013/413565

    MATH  Google Scholar 

  53. Kai X, Gao L, Wang L, Li W, Chao K-M (2013) A simplified teaching–learning-based optimization algorithm for disassembly sequence planning. In: IEEE 10th international conference on e-business engineering (ICEBE), pp 393–398. doi:10.1109/ICEBE.2013.60

  54. Savsani P, Jhala RL, Savsani VJ (2013) Optimized trajectory planning of a robotic arm using teaching learning based optimization (TLBO) and artificial bee colony (ABC) optimization techniques In: IEEE international systems conference (SysCon), pp 381–386. doi:10.1109/SysCon.2013.6549910

  55. Gao W-J, Xing B, Marwala T (2013) Teaching–learning-based optimization approach for enhancing remanufacturability pre-evaluation system’s reliability. In: IEEE symposium on swarm intelligence (SIS), pp 235–239. doi:10.1109/SIS.2013.6615184

  56. Gonzalez-Alvarez DL, Vega-Rodriguez MA, Gomez-Pulido JA, Sanchez-Perez JM (2012) Multiobjective teaching–learning-based optimization (MO-TLBO) for motif finding. In: IEEE 13th international symposium on computational intelligence and informatics (CINTI), pp 141–146. doi:10.1109/CINTI.2012.6496749

  57. Theja BS, Rajasekhar A, Abraham A (2013) An optimal design of coordinated PI based PSS with TCSC controller using modified teaching learning based optimization. In: World Congress on nature and biologically inspired computing (NaBIC), pp 99–106. doi:10.1109/NaBIC.2013.6617845

  58. Sultana S, Roy PK (2014) Optimal capacitor placement in radial distribution systems using teaching learning based optimization. Electr Power Energy Syst 54:387–398

    Article  Google Scholar 

  59. Rasoul A-A, Taher N, Farhad B, Mohsen Z (2014) Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm. Electr Power Syst Res 108:16–34

    Article  Google Scholar 

  60. Arya LD, Koshti A (2014) Anticipatory load shedding for line overload alleviation using Teaching learning based optimization (TLBO). Electr Power Energy Syst 63:862–877

    Article  Google Scholar 

  61. Reza KM, Hassan KM (2014) A novel self-tuning control method based on regulated bi-objective emotional learning controller’s structure with TLBO algorithm to control DVR compensator. Appl Soft Comput 24:912–922

    Article  Google Scholar 

  62. Niu Q, Zhang H, Li K (2014) An improved TLBO with elite strategy for parameters identification of PEM fuel cell and solar cell models. Int J Hydrogen Energy 39(2014):3837–3854

    Article  Google Scholar 

  63. Moghadam A, Seifi AR (2014) Fuzzy-TLBO optimal reactive power control variables planning for energy loss minimization. Energy Convers Manag 77:208–215

    Article  Google Scholar 

  64. Gonzalez-Alvarez DL, Vega-Rodriguez MA, Rubio-Largo A (2014) Finding patterns in protein sequences by using a hybrid multiobjective teaching learning based optimization algorithm. Issue: 99. doi:10.1109/TCBB.2014.2369043

  65. Yammani C, Sowjanya G, Maheswarapu S, Matam SK (2014) Optimal placement and sizing of DER’s with load models using a modified teaching learning based optimization algorithm. In: International conference on green computing communication and electrical engineering (ICGCCEE). doi:10.1109/ICGCCEE.2014.6922306

  66. Cheng Y-H (2014) Estimation of teaching–learning-based optimization primer design using regression analysis for different melting temperature calculations. IEEE Trans Nano Biosci. doi:10.1109/TNB.2014.2352351

    Google Scholar 

  67. Sahoo S, Murty SB, Krishna KM (2015) Character recognition using teaching learning based optimization. Adv Intell Syst Comput 327:737–744

    Article  Google Scholar 

  68. Agrawal S, Sharma S, Silakari S (2014) Teaching learning based optimization (TLBO) based improved iris recognition system. Adv Intell Syst Comput 330:735–740

    Google Scholar 

  69. Barisal AK (2015) Comparative performance analysis of teaching learning based optimization for automatic load frequency control of multi-source power systems. Electr Power Energy Syst 66:67–77

    Article  Google Scholar 

  70. Mojtaba G, Mahdi T, Sahand G, Jamshid A, Abbas A (2015) Solving optimal reactive power dispatch problem using a novel teaching–learning-based optimization algorithm. Eng Appl Artif Intell 39:100–108

    Article  Google Scholar 

  71. Debao C, Feng Z, Zheng L, Jiangtao W, Suwen L (2015) An improved teaching–learning-based optimization algorithm for solving global optimization problem. Inf Sci 297:171–190

    Article  Google Scholar 

  72. Kumar SB, Swagat P, Kumar MP, Sidhartha P (2015) Teaching–learning based optimization algorithm based fuzzy-PID controller for automatic generation control of multi-area power system. Appl Soft Comput 27:240–249

    Article  Google Scholar 

  73. Mojtaba G, Sahand G, Mohsen G, Ebrahim A (2015) An improved teaching–learning-based optimization algorithm using Lévy mutation strategy for non-smooth optimal power flow. Electr Power Energy Syst 65:375–384

    Article  Google Scholar 

  74. Chakravarthy VVSSS, Naveen Babu K, Suresh S, Chaya Devi P, Mallikarjuna RP (2015) Linear array optimization using teaching learning based optimization. Adv Intell Syst Comput 338:183–190

    Article  Google Scholar 

  75. Kumar MP, Chandra SS (2015) An hybrid approach for data clustering using K-means and teaching learning based optimization. Adv Intell Syst Comput 338:165–171

    Article  Google Scholar 

  76. Rajasekhar A, Rani R, Ramya K, Abraham A (2012) Elitist teaching learning opposition based algorithm for global optimization. In: IEEE international conference on systems, man, and cybernetics (SMC), pp 1124–1129

  77. Shin Y, Ghosh J (1991) The Pi-sigma networks : an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of international joint conference on neural networks, Seattle, Washington, vol 1, pp 13–18

  78. Nayak J, Naik B, Behera HS (2015) A novel chemical reaction optimization based higher order neural network (CRO-HONN) for nonlinear classification. Ain Shams Eng J. doi:10.1016/j.asej.2014.12.013

    Google Scholar 

  79. Nayak J, Naik B, Behera HS (2014) A hybrid PSO–GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification. In: IEEE international conference on control, instrumentation, communication and computational technologies (ICCICCT), 2014, pp 878–885. doi:10.1109/ICCICCT.2014.6993082

  80. Ghosh J, Shin Y (1992) Efficient higher-order neural networks for classification and function approximation. Int J Neural Syst 3:323–350

    Article  Google Scholar 

  81. Shin Y, Ghosh J (1991) Realization of boolean functions using binary pi-sigma networks. In: Dagli CH, Kumara SRT, Shin YC (eds) Intelligent engineering systems through artificial neural networks. ASME Press, New York, pp 205–210

    Google Scholar 

  82. Jordan MI (1986) Attractor dynamics and parallelism in a connectionist sequential machine. In: Proceedings of the eighth conference of the cognitive science society, New Jersey, USA

  83. Ghazali R, Husaini NA, Ismail LH, Samsuddin NA (2012) An application of Jordan Pi-sigma neural network for the prediction of temperature time series signal. Recurr Neural Netw Soft Comput 13:275–290

    Google Scholar 

  84. Nayak J, Kanungo DP, Naik B, Behera HS (2014) A higher order evolutionary Jordan Pi-sigma neural network with gradient descent learning for classification. In: IEEE international conference on high performance computing and applications (ICHPCA), pp 1–6. doi:10.1109/ICHPCA.2014.7045328

  85. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(9):533–536

    Article  MATH  Google Scholar 

  86. Bache K, Lichman M (2013) UCI machine learning repository [http://archive.ics.uci.edu/ml]. University of California, School of Information and Computer Science, Irvine

  87. Alcala-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) keel data-mining software tool: data set repository. Integration of algorithms and experimental analysis framework. J Mult Valued Log Soft Comput 17(2–3):255–287

    Google Scholar 

  88. Larson S (1931) The shrinkage of the coefficient of multiple correlation. J Educ Psychol 22:45–55

    Article  Google Scholar 

  89. Mosteller F, Turkey JW (1968) Data analysis, including statistics. In: Handbook of Social Psychology, vol 2, pp 80–203

  90. Pao YH (1989) Adaptive pattern recognition and neural networks. Addison-Wesley, Reading

    MATH  Google Scholar 

  91. Pao YH, Takefuji Y (1992) Functional-link net computing: theory, system architecture, and functionalities. Computer 25:76–79

    Article  Google Scholar 

  92. Naik B, Nayak J, Behera HS (2015) An efficient FLANN model with CRO-based gradient descent learning for classification. Int J Bus Inf Syst 21(1):73–116

    Google Scholar 

  93. Naik B, Nayak J, Behera HS (2015) A global-best harmony search based gradient descent learning FLANN (GbHS-GDL-FLANN) for data classification. Egypt Inf J (in Press)

  94. Naik B, Nayak J, Behera HS, Abraham A (2015) A self adaptive harmony search based functional link higher order ANN for non-linear data classification. Neurocomputing. doi:10.1016/j.neucom.2015.11.051

    Google Scholar 

  95. Dash CSK et al. (2015) Towards crafting an improved functional link artificial neural network based on differential evolution and feature selection. Informatica 39(2):195–208

    MathSciNet  Google Scholar 

  96. Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30

    MathSciNet  MATH  Google Scholar 

  97. Fisher RA (1959) Statistical methods and scientific inference, 2nd edn. Hafner Publishing Co., New York

    Google Scholar 

  98. Nayak J, Naik B, Behera HS, Abraham A (2015) Particle swarm optimization based higher order neural network for classification. Smart Innov Syst Technol 31:401–414

    Article  Google Scholar 

  99. Tukey JW (1949) Comparing individual means in the analysis of variance. Biometrics 5:99–114

    Article  MathSciNet  Google Scholar 

  100. Dunnett CW (1980) A multiple comparison procedure for comparing several treatments with a control. J Am Stat Assoc 50:1096–1121

    Article  MATH  Google Scholar 

  101. Friedman MA (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701

    Article  MATH  Google Scholar 

  102. Friedman MA (1940) Comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11:86–92

    Article  MathSciNet  MATH  Google Scholar 

  103. Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat 9:571–595

    Article  MATH  Google Scholar 

  104. Garcia S, Fernandez A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180:2044–2064

    Article  Google Scholar 

  105. Luengo J, Garcia S, Herrera F (2009) A study on the use of statistical tests for experimentation with neural networks: analysis of parametric test conditions and non-parametric tests. Expert Syst Appl 36:7798–7808

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by Department of Science and Technology (DST), Ministry of Science and Technology, New Delhi, Government of India, under Grants No. DST/INSPIRE Fellowship/2013/585. The author would like to thank to the editor and the reviewers for their valuable comments and suggestions that helped to improve the content of the paper in a large extent.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Janmenjoy Nayak.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nayak, J., Naik, B., Behera, H.S. et al. Elitist teaching–learning-based optimization (ETLBO) with higher-order Jordan Pi-sigma neural network: a comparative performance analysis. Neural Comput & Applic 30, 1445–1468 (2018). https://doi.org/10.1007/s00521-016-2738-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-016-2738-1

Keywords

Navigation