Abstract
This paper presents the performance analysis of a newly developed elitist teaching–learning-based optimization algorithm applied with an efficient higher-order Jordan Pi-sigma neural network (JPSNN) for real-world data classification. Teaching–learning-based optimization (TLBO) algorithm is a recent metaheuristic, which is inspired through the teaching and learning process of both teacher and learner. As compared to other algorithms, it is efficient and robust due to its non-controlling parameter adjustments feature. Elitist TLBO is an improved version of TLBO with the addition of elitist solutions, which makes it more efficient. During the experiment, first the TLBO and then ETLBO algorithm are applied with only Pi-sigma neural network and its performance has been compared with other methods such as GA and PSO. Then, the ETLBO algorithm is applied with JPSNN and found better results over other methods. The proposed method has been tested with real-world benchmark datasets considered from UCI machine learning repository, and the performance has been compared with all seven approaches along with other HONN to prove the effectiveness of the method. Simulation results and statistical analysis show the superiority in the performance of the proposed approach as well as prove the potentiality over other existing approaches.
















Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Holland JH (1992) Genetic algorithms. Scientific American, New York, pp 66–72
Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks vol 4, pp 1942–1948
Alatas B, Akın E (2005) FCACO: fuzzy classification rules mining algorithm with ant colony optimization. In: ICNC 2005. Lecture notes in computer science, vol 3612. Springer, Berlin, pp 787–797
Dorigo M, Maziezzo V, Colorni A (1996) The ant system: optimization by a colony of cooperating ants. IEEE Trans Syst Man Cybern B 26(1):29–41
Alatas B (2010) Chaotic bee colony algorithms for global numerical optimization. Expert Syst Appl 37(8):5682–5687
Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471
Li XL (2003) New intelligent optimization-artificial fish swarm algorithm. PhD thesis, Zhejiang University, China
Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76:60–70
Yin M, Hu Y, Yang F, Li X, Gu W (2011) A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering. Expert Syst Appl 38(8):9319–9324
Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications SAGA 2009. Lecture notes in computer sciences, vol 5792, pp 169–178
Krishnanand KN, Ghose D (2006) Glowworm swarm based optimization algorithm for multimodal functions with collective robotics applications. Multiagent Grid Syst 2(3):209–222
Wu B, Qian C, Ni W, Fan S (2012) The improvement of glowworm swarm for continuous optimization problems. Expert Syst Appl 39(7):6335–6342
Jamili A, Shafia MA, Tavakkoli-Moghaddam R (2011) A hybridization of simulated annealing and electro magnetism-like mechanism for a periodic job shop scheduling problem. Expert Syst Appl 38(5):5895–5901
Birbil SI, Fang SC (2003) An electromagnetism-like mechanism for global optimization. J Global Optim 25:263–282
Xie L, Zeng J, Cui Z (2009) General framework of artificial physics optimization algorithm. In: IEEE nature & biologically inspired computing, pp 1321–1326
Alatas B (2011) Uniform big bang-chaotic big crunch optimization. Commun Nonlinear Sci Numer Simul 16(9):3696–3703
Erol OK, Eksin I (2006) A new optimization method: big bang-big crunch. Adv Eng Softw 37:106–111
Kaveh A, Laknejadi K (2011) A novel hybrid charge system search and particle swarm optimization method for multi-objective optimization. Expert Syst Appl 38(12):15475–15488
Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213(3–4):267–289
Sacco WF, de Oliveira CRE (2005) A new stochastic optimization algorithm based on a particle collision metaheuristic. In: 6th world congresses of structural and multidisciplinary optimization
Formato RA (2007) Central force optimization: a new metaheuristic with applications in applied electromagnetics. Prog Electromagn Res PIER 77:425–491
Green RC, Wang L, Alam M (2012) Training neural networks using central force optimization and particle swarm optimization: insights and comparisons. Expert Syst Appl 39(1):555–563
Rao RV, Savsani VJ, Vakharia DP (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43:303–315
Rao RV, Savsani VJ, Vakharia DP (2012) Teaching–learning-based optimization: an optimization method for continuous non-linear large scale problems. Inf Sci 183:1–15
Rao RV, Vivek P (2013) An improved teaching–learning-based optimization algorithm for solving unconstrained optimization problems. Scientia Iranica D 20(3):710–720
Venkata Rao R, Patel V (2012) An elitist teaching–learning-based optimization algorithm for solving complex constrained optimization problems. Int J Ind Eng Comput 3:535–560
Rao RV, Waghmare GG (2013) A comparative study of a teaching–learning-based optimization algorithm on multi-objective unconstrained and constrained functions. J King Saud Univ Comput Inf Sci. doi:10.1016/j.jksuci.2013.12.004
Rao RV, More KC (2015) Optimal design of the heat pipe using TLBO (teaching–learning-based optimization) algorithm. Energy 80:535–544
Ergun U, Murat K, Adem A, Tayfun D (2014) Estimates of energy consumption in Turkey using neural networks with the teaching–learning-based optimization algorithm. Energy 75:295–303
Wang L, Zou F, Hei X, Yang D, Chen D, Jiang Q (2014) An improved teaching–learning-based optimization with neighborhood search for applications of ANN. Neurocomputing 143:231–247
Basu M (2014) Teaching–learning-based optimization algorithm for multi-area economic dispatch. Energy 68:21–28
Yang Z, Li K, Foley A, Zhang C (2014) A new self-learning TLBO algorithm for RBF neural modelling of batteries in electric vehicles. In: IEEE congress on evolutionary computation (CEC), pp 2685–2691. doi:10.1109/CEC.2014.6900428
Medina MA, Coello Coello CA, Ramirez JM (2013) Reactive power handling by a multi-objective teaching learning optimizer based on decomposition. IEEE Trans Power Syst 28(4):3629–3637. doi:10.1109/TPWRS.2013.2272196
Nayak MR, Nayak CK, Rout PK (2012) Application of multi-objective teaching learning based optimization algorithm to optimal power flow problem. Proc Technol 6:255–264
Toğan V (2012) Design of planar steel frames using teaching-learning based optimization. Eng Struct 34:225–232
Niknam T, Golestaneh F, Sadeghi MS (2012) θ-multiobjective teaching–learning-based optimization for dynamic economic emission dispatch. IEEE Syst J 6(2):341–352. doi:10.1109/JSYST.2012.2183276
Jadhav HT, Chawla D, Roy R (2012) Modified teaching–learning based algorithm for economic load dispatch incorporating wind power. In: 11th international conference on environment and electrical engineering (EEEIC), pp 397–402. doi:10.1109/EEEIC.2012.6221410
Satapathy SC, Naik A, Parvathi K (2012) Teaching learning based optimization for neural networks learning enhancement. Lect Notes Comput Sci 7677:761–769
Zou F, Wang L, Hei X, Chen D, Wang B (2013) Multi-objective optimization using teaching–learning-based optimization algorithm. Eng Appl Artif Intell 26:1291–1300
Kumar RP, Aditi S, Kumar PD (2013) Optimal short-term hydro-thermal scheduling using quasi-oppositional teaching learning based optimization. Eng Appl Artif Intell 26:2516–2524
Mandal B, Roy PK (2013) Optimal reactive power dispatch using quasi-oppositional teaching learning based optimization. Electr Power Energy Syst 53:123–134
García JAM, Mena AJG (2013) Optimal distributed generation location and size using a modified teaching–learning based optimization algorithm. Electr Power Energy Syst 50:65–75
Venkata RR, Kalyankar VD (2013) Parameter optimization of modern machining processes using teaching–learning-based optimization algorithm. Eng Appl Artif Intell 26:524–531
Roy PK (2013) Teaching learning based optimization for short-term hydrothermal scheduling problem considering valve point effect and prohibited discharge constraint. Electr Power Energy Syst 53:10–19
Roy PK, Bhui S (2013) Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem. Electr Power Energy Syst 53(2013):937–948
Singh M, Panigrahi BK, Abhyankar AR (2013) Optimal coordination of directional over-current relays using teaching–learning-based optimization (TLBO) algorithm. Electr Power Energy Syst 50:33–41
Wang K-L, Wang H-B, Yu L-X, Ma X-Y, Xue Y-S (2013) Toward teaching-learning-based optimization algorithm for dealing with real-parameter optimization problems. In: Proceedings of the 2nd international conference on computer science and electronics engineering (ICCSEE 2013), pp 0606–0609
Satapathy SC, Naik A, Parvathi K (2013) Weighted teaching–learning-based optimization for global function optimization. Appl Math 4:429–439
Satapathy SC, Naik A, Parvathi K (2013) A teaching learning based optimization based on orthogonal design for solving global optimization problems. Springer Plus 2:130
Tuo S, Yong L, Zhou T (2013) An improved harmony search based on teaching–learning strategy for unconstrained optimization problems. Math Problems Eng. doi:10.1155/2013/413565
Kai X, Gao L, Wang L, Li W, Chao K-M (2013) A simplified teaching–learning-based optimization algorithm for disassembly sequence planning. In: IEEE 10th international conference on e-business engineering (ICEBE), pp 393–398. doi:10.1109/ICEBE.2013.60
Savsani P, Jhala RL, Savsani VJ (2013) Optimized trajectory planning of a robotic arm using teaching learning based optimization (TLBO) and artificial bee colony (ABC) optimization techniques In: IEEE international systems conference (SysCon), pp 381–386. doi:10.1109/SysCon.2013.6549910
Gao W-J, Xing B, Marwala T (2013) Teaching–learning-based optimization approach for enhancing remanufacturability pre-evaluation system’s reliability. In: IEEE symposium on swarm intelligence (SIS), pp 235–239. doi:10.1109/SIS.2013.6615184
Gonzalez-Alvarez DL, Vega-Rodriguez MA, Gomez-Pulido JA, Sanchez-Perez JM (2012) Multiobjective teaching–learning-based optimization (MO-TLBO) for motif finding. In: IEEE 13th international symposium on computational intelligence and informatics (CINTI), pp 141–146. doi:10.1109/CINTI.2012.6496749
Theja BS, Rajasekhar A, Abraham A (2013) An optimal design of coordinated PI based PSS with TCSC controller using modified teaching learning based optimization. In: World Congress on nature and biologically inspired computing (NaBIC), pp 99–106. doi:10.1109/NaBIC.2013.6617845
Sultana S, Roy PK (2014) Optimal capacitor placement in radial distribution systems using teaching learning based optimization. Electr Power Energy Syst 54:387–398
Rasoul A-A, Taher N, Farhad B, Mohsen Z (2014) Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm. Electr Power Syst Res 108:16–34
Arya LD, Koshti A (2014) Anticipatory load shedding for line overload alleviation using Teaching learning based optimization (TLBO). Electr Power Energy Syst 63:862–877
Reza KM, Hassan KM (2014) A novel self-tuning control method based on regulated bi-objective emotional learning controller’s structure with TLBO algorithm to control DVR compensator. Appl Soft Comput 24:912–922
Niu Q, Zhang H, Li K (2014) An improved TLBO with elite strategy for parameters identification of PEM fuel cell and solar cell models. Int J Hydrogen Energy 39(2014):3837–3854
Moghadam A, Seifi AR (2014) Fuzzy-TLBO optimal reactive power control variables planning for energy loss minimization. Energy Convers Manag 77:208–215
Gonzalez-Alvarez DL, Vega-Rodriguez MA, Rubio-Largo A (2014) Finding patterns in protein sequences by using a hybrid multiobjective teaching learning based optimization algorithm. Issue: 99. doi:10.1109/TCBB.2014.2369043
Yammani C, Sowjanya G, Maheswarapu S, Matam SK (2014) Optimal placement and sizing of DER’s with load models using a modified teaching learning based optimization algorithm. In: International conference on green computing communication and electrical engineering (ICGCCEE). doi:10.1109/ICGCCEE.2014.6922306
Cheng Y-H (2014) Estimation of teaching–learning-based optimization primer design using regression analysis for different melting temperature calculations. IEEE Trans Nano Biosci. doi:10.1109/TNB.2014.2352351
Sahoo S, Murty SB, Krishna KM (2015) Character recognition using teaching learning based optimization. Adv Intell Syst Comput 327:737–744
Agrawal S, Sharma S, Silakari S (2014) Teaching learning based optimization (TLBO) based improved iris recognition system. Adv Intell Syst Comput 330:735–740
Barisal AK (2015) Comparative performance analysis of teaching learning based optimization for automatic load frequency control of multi-source power systems. Electr Power Energy Syst 66:67–77
Mojtaba G, Mahdi T, Sahand G, Jamshid A, Abbas A (2015) Solving optimal reactive power dispatch problem using a novel teaching–learning-based optimization algorithm. Eng Appl Artif Intell 39:100–108
Debao C, Feng Z, Zheng L, Jiangtao W, Suwen L (2015) An improved teaching–learning-based optimization algorithm for solving global optimization problem. Inf Sci 297:171–190
Kumar SB, Swagat P, Kumar MP, Sidhartha P (2015) Teaching–learning based optimization algorithm based fuzzy-PID controller for automatic generation control of multi-area power system. Appl Soft Comput 27:240–249
Mojtaba G, Sahand G, Mohsen G, Ebrahim A (2015) An improved teaching–learning-based optimization algorithm using Lévy mutation strategy for non-smooth optimal power flow. Electr Power Energy Syst 65:375–384
Chakravarthy VVSSS, Naveen Babu K, Suresh S, Chaya Devi P, Mallikarjuna RP (2015) Linear array optimization using teaching learning based optimization. Adv Intell Syst Comput 338:183–190
Kumar MP, Chandra SS (2015) An hybrid approach for data clustering using K-means and teaching learning based optimization. Adv Intell Syst Comput 338:165–171
Rajasekhar A, Rani R, Ramya K, Abraham A (2012) Elitist teaching learning opposition based algorithm for global optimization. In: IEEE international conference on systems, man, and cybernetics (SMC), pp 1124–1129
Shin Y, Ghosh J (1991) The Pi-sigma networks : an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of international joint conference on neural networks, Seattle, Washington, vol 1, pp 13–18
Nayak J, Naik B, Behera HS (2015) A novel chemical reaction optimization based higher order neural network (CRO-HONN) for nonlinear classification. Ain Shams Eng J. doi:10.1016/j.asej.2014.12.013
Nayak J, Naik B, Behera HS (2014) A hybrid PSO–GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification. In: IEEE international conference on control, instrumentation, communication and computational technologies (ICCICCT), 2014, pp 878–885. doi:10.1109/ICCICCT.2014.6993082
Ghosh J, Shin Y (1992) Efficient higher-order neural networks for classification and function approximation. Int J Neural Syst 3:323–350
Shin Y, Ghosh J (1991) Realization of boolean functions using binary pi-sigma networks. In: Dagli CH, Kumara SRT, Shin YC (eds) Intelligent engineering systems through artificial neural networks. ASME Press, New York, pp 205–210
Jordan MI (1986) Attractor dynamics and parallelism in a connectionist sequential machine. In: Proceedings of the eighth conference of the cognitive science society, New Jersey, USA
Ghazali R, Husaini NA, Ismail LH, Samsuddin NA (2012) An application of Jordan Pi-sigma neural network for the prediction of temperature time series signal. Recurr Neural Netw Soft Comput 13:275–290
Nayak J, Kanungo DP, Naik B, Behera HS (2014) A higher order evolutionary Jordan Pi-sigma neural network with gradient descent learning for classification. In: IEEE international conference on high performance computing and applications (ICHPCA), pp 1–6. doi:10.1109/ICHPCA.2014.7045328
Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(9):533–536
Bache K, Lichman M (2013) UCI machine learning repository [http://archive.ics.uci.edu/ml]. University of California, School of Information and Computer Science, Irvine
Alcala-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) keel data-mining software tool: data set repository. Integration of algorithms and experimental analysis framework. J Mult Valued Log Soft Comput 17(2–3):255–287
Larson S (1931) The shrinkage of the coefficient of multiple correlation. J Educ Psychol 22:45–55
Mosteller F, Turkey JW (1968) Data analysis, including statistics. In: Handbook of Social Psychology, vol 2, pp 80–203
Pao YH (1989) Adaptive pattern recognition and neural networks. Addison-Wesley, Reading
Pao YH, Takefuji Y (1992) Functional-link net computing: theory, system architecture, and functionalities. Computer 25:76–79
Naik B, Nayak J, Behera HS (2015) An efficient FLANN model with CRO-based gradient descent learning for classification. Int J Bus Inf Syst 21(1):73–116
Naik B, Nayak J, Behera HS (2015) A global-best harmony search based gradient descent learning FLANN (GbHS-GDL-FLANN) for data classification. Egypt Inf J (in Press)
Naik B, Nayak J, Behera HS, Abraham A (2015) A self adaptive harmony search based functional link higher order ANN for non-linear data classification. Neurocomputing. doi:10.1016/j.neucom.2015.11.051
Dash CSK et al. (2015) Towards crafting an improved functional link artificial neural network based on differential evolution and feature selection. Informatica 39(2):195–208
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Fisher RA (1959) Statistical methods and scientific inference, 2nd edn. Hafner Publishing Co., New York
Nayak J, Naik B, Behera HS, Abraham A (2015) Particle swarm optimization based higher order neural network for classification. Smart Innov Syst Technol 31:401–414
Tukey JW (1949) Comparing individual means in the analysis of variance. Biometrics 5:99–114
Dunnett CW (1980) A multiple comparison procedure for comparing several treatments with a control. J Am Stat Assoc 50:1096–1121
Friedman MA (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701
Friedman MA (1940) Comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11:86–92
Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat 9:571–595
Garcia S, Fernandez A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180:2044–2064
Luengo J, Garcia S, Herrera F (2009) A study on the use of statistical tests for experimentation with neural networks: analysis of parametric test conditions and non-parametric tests. Expert Syst Appl 36:7798–7808
Acknowledgements
This work is supported by Department of Science and Technology (DST), Ministry of Science and Technology, New Delhi, Government of India, under Grants No. DST/INSPIRE Fellowship/2013/585. The author would like to thank to the editor and the reviewers for their valuable comments and suggestions that helped to improve the content of the paper in a large extent.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nayak, J., Naik, B., Behera, H.S. et al. Elitist teaching–learning-based optimization (ETLBO) with higher-order Jordan Pi-sigma neural network: a comparative performance analysis. Neural Comput & Applic 30, 1445–1468 (2018). https://doi.org/10.1007/s00521-016-2738-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-016-2738-1