Skip to main content

Advertisement

Springer Nature Link
Log in

Higher order ANN parameter optimization using hybrid opposition-elitism based metaheuristic

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

For two decades, the dominance of nature-inspired optimization algorithms has been irresistible in solving many complex problems. In fact, most of these algorithms are integrated with some other intelligent technique to prove the effectiveness of each method. Out of these algorithms, the last decade has witnessed a good research contribution for Teaching–Learning Based optimization and its different variations as well as advances in many engineering domains. In this research, a variation of the TLBO technique has been integrated with the Functional Link Artificial Neural Network to classify the nonlinear data. With suitable parameter adjustments, the proposed model can classify the data efficiently. For learning, the Gradient Descent method has been adopted for obtaining the optimal weight units of the neural network. Simulation results reveal that the proposed hybrid approach is superior in terms of considered performance parameters as compared to other competitive methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Aadit MNA, Mahin MT, Juthi SN (2017) Spontaneous micro-expression recognition using optimal firefly algorithm coupled with ISO-FLANN classification. In: 2017 IEEE region 10 humanitarian technology conference (R10-HTC) (pp 714–717). IEEE

  2. Alcalá-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Multiple-Valued Logic Soft Comput 17(2–3):255–287

    Google Scholar 

  3. Alomoush AA, Alsewari AA, Alamri HS, Aloufi KS, Zamli KZ (2019) Hybrid harmony search algorithm with grey wolf optimizer and modified opposition-based learning. IEEE Access

  4. Bache K, Lichman M (2013) ‘UCI machine learning repository [http://archive.ics.uci.edu/ml]’, Irvine, CA: University of California, School of Information and Computer Science

  5. Bu JG, Zhou M, Lan XD, Lv KX (2017) Optimization for airgap flux density waveform of flywheel motor using NSGA-2 and Kriging model based on MaxPro design. IEEE Trans Magn 53(8):1–7

    Article  Google Scholar 

  6. Cao J, Luo J (2015) A study on SVM based on the weighted elitist teaching-learning-based optimization and application in the fault diagnosis of chemical process. In: MATEC web of conferences (Vol 22, p 05016). EDP Sciences.

  7. Chakraverty S, Mall S (2020) Single layer Chebyshev neural network model with regression-based weights for solving nonlinear ordinary differential equations. Evol. Intel. 13:687–694. https://doi.org/10.1007/s12065-020-00383-y

    Article  Google Scholar 

  8. Chakraborty F, Nandi D, Roy PK (2019) Oppositional symbiotic organisms search optimization for multilevel thresholding of color image. Appl Soft Comput 82:105577

    Article  Google Scholar 

  9. Chu M, Wu X (2018) Modeling and self-learning soft-grasp control for free-floating space manipulator during target capturing using variable stiffness method. IEEE Access 6:7044–7054

    Article  Google Scholar 

  10. Colace F, Loia V, Pedrycz W, Tomasiello S (2020) On a granular functional link network for classification. Neurocomputing 398:108–116

    Article  Google Scholar 

  11. Dehuri S, Roy R, Cho SB, Ghosh A (2012) An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification. J Syst Softw 85(6):1333–1345

    Article  Google Scholar 

  12. Dorigo M, Stützle T (2003) The ant colony optimization metaheuristic: algorithms, applications, and advances. Handbook of metaheuristics. Springer, Boston, MA, pp 250–285. https://doi.org/10.1007/0-306-48056-5_9

    Chapter  Google Scholar 

  13. Du H, Wang Z, Zhan W, Guo J (2018) Elitism and distance strategy for selection of evolutionary algorithms. IEEE Access 6:44531–44541

    Article  Google Scholar 

  14. Ergezer M, Simon D (2014) Mathematical and experimental analyses of oppositional algorithms. IEEE Trans Cybern 44(11):2178–2189

    Article  Google Scholar 

  15. Friedman MA (1940) comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11:86–92

    Article  MathSciNet  MATH  Google Scholar 

  16. García S, Fernández A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Inf Sci 180(10):2044–2064

    Article  Google Scholar 

  17. Geem ZW, Kim J-H, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. SIMULATION 76(2):60–68

    Article  Google Scholar 

  18. Guo W, Wang Y, Zhao F, Dai F (2019) Riesz fractional derivative Elite-guided sine cosine algorithm. Appl Soft Comput 81:105481

    Article  Google Scholar 

  19. Gupta S, Deep K (2019) A hybrid self-adaptive sine cosine algorithm with opposition based learning. Expert Syst Appl 119:210–230

    Article  Google Scholar 

  20. Hazarika BB, Gupta D (2020) Modelling and forecasting of COVID-19 spread using wavelet-coupled random vector functional link networks. Appl Soft Comput 96:106626

    Article  Google Scholar 

  21. Hochberg Y (1988) “A Sharper Bonferroni Procedure for Multiple Tests of Significance” (PDF). Biometrika 75(4):800–802. https://doi.org/10.1093/biomet/75.4.800

    Article  MathSciNet  MATH  Google Scholar 

  22. Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor

    Google Scholar 

  23. Jain P, Saxena A (2019) An opposition theory enabled moth flame optimizer for strategic bidding in uniform spot energy market. Eng Sci Technol Int J 22:1047–1067

    Google Scholar 

  24. Peng J, Liu M, Xi Z, Ling L (2019) Hybrid heuristic algorithm for multi-objective scheduling problem. J Syst Eng Electron 30(2):327–342

    Article  Google Scholar 

  25. Kang Q, Xiong C, Zhou M, Meng L (2018) Opposition-based hybrid strategy for particle swarm optimization in noisy environments. IEEE Access 6:21888–21900

    Article  Google Scholar 

  26. Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471

    Article  MathSciNet  MATH  Google Scholar 

  27. Kennedy J, Eberhart RC (1995) ‘Particle swarm optimization’. In: Proceedings of IEEE international conference on neural networks, Piscataway, NJ, pp 1942–1948

  28. Kumar S, Mandal KK, Chakraborty N (2019) Optimal DG placement by multi-objective opposition based chaotic differential evolution for techno-economic analysis. Appl Soft Comput 78:70–83

    Article  Google Scholar 

  29. Li F, Feng J, Zhang H, Liu J, Lu S, Ma D (2018) Quick reconstruction of arbitrary pipeline defect profiles from MFL measurements employing modified harmony search algorithm. IEEE Trans Instrum Meas 67(9):2200–2213

    Article  Google Scholar 

  30. Li M, Zhao H, Weng X, Huang H (2015) Artificial bee colony algorithm with comprehensive search mechanism for numerical optimization. J Syst Eng Electron 26(3):603–617

    Article  Google Scholar 

  31. Li W, He Z, Zheng J, Hu Z (2019) Improved flower pollination algorithm and its application in user identification across social networks. IEEE Access 7:44359–44371

    Article  Google Scholar 

  32. Liu ZH, Wei HL, Li XH, Liu K, Zhong QC (2018) Global identification of electrical and mechanical parameters in PMSM drive based on dynamic self-learning PSO. IEEE Trans Power Electron 33(12):10858–10871

    Article  Google Scholar 

  33. Liu ZH, Wei HL, Zhong QC, Liu K, Xiao XS, Wu LH (2016) Parameter estimation for VSI-fed PMSM based on a dynamic PSO with learning strategies. IEEE Trans Power Electron 32(4):3154–3165

    Article  Google Scholar 

  34. Ganaie MA, Tanveer M (2020) LSTSVM classifier with enhanced features from pre-trained functional link network. Appl Soft Comput 93(2020):106305

    Article  Google Scholar 

  35. Mallick PK, Satapathy SK, Mishra S, Panda AR, Mishra D (2019) Feature selection and classification for microarray data using ACO-FLANN framework. Intelligent and cloud computing. Springer, Singapore, pp 491–501. https://doi.org/10.1007/978-981-15-5971-6_53

    Chapter  Google Scholar 

  36. Mandal B, Roy PK (2013) Optimal reactive power dispatch using quasi-oppositional teaching learning based optimization. Int J Electr Power Energy Syst 53:123–134

    Article  Google Scholar 

  37. Mandal B, Roy PK (2014) Multi-objective optimal power flow using quasi-oppositional teaching learning based optimization. Appl Soft Comput 21:590–606

    Article  Google Scholar 

  38. Naik B, Nayak J, Behera HS, Abraham A (2016) A self adaptive harmony search based functional link higher order ANN for non-linear data classification. Neurocomputing 179:69–87

    Article  Google Scholar 

  39. Naik B, Nayak J, Behera HS (2018) A TLBO based gradient descent learning-functional link higher order ANN: an efficient model for learning from non-linear data. J King Saud Univ-Comput Inf Sci 30(1):120–139

    Google Scholar 

  40. Naik A, Satapathy SC, Parvathi K (2012) Improvement of initial cluster center of c-means using teaching learning based optimization. Procedia Technol 6:428–435

    Article  Google Scholar 

  41. Nayak J, Naik B, Chandrasekhar GT, Behera HS (2019) A survey on teaching–learning-based optimization algorithm: short journey from 2011 to 2017. Computational intelligence in data mining. Springer, Singapore, pp 739–758. https://doi.org/10.1007/978-981-10-8055-5_66

    Chapter  Google Scholar 

  42. Nayak SC, Misra BB, Behera HS (2019) ACFLN: artificial chemical functional link network for prediction of stock market index. Evol Syst 10(4):567–592

    Article  Google Scholar 

  43. Niknam T, Golestaneh F, Sadeghi MS (2012) $\theta $-multiobjective teaching–learning-based optimization for dynamic economic emission dispatch. IEEE Syst J 6(2):341–352

    Article  Google Scholar 

  44. Pao YH (1989) Adaptive pattern recognition and neural networks. Addison-Wesley Pub, Boston

    MATH  Google Scholar 

  45. Passino KM (2002) Biomimicry of bacterial foraging for distributed optimization and control. IEEE Control Syst Mag 22(3):52–67

    Article  Google Scholar 

  46. Qiao J, Zhou H, Yang C (2018) Bare-bones multiobjective particle swarm optimization based on parallel cell balanceable fitness estimation. IEEE Access 6:32493–32506

    Article  Google Scholar 

  47. Raghu PP, Poongodi R, Yegnanarayana B (1995) A combined neural network approach for texture classification. Neural Netw 8(6):975–987

    Article  Google Scholar 

  48. Rajasekhar A, Rani R, Ramya K, Abraham A (2012) Elitist teaching learning opposition based algorithm for global optimization. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 1124–1129

  49. Rao R, Patel V (2012) An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems. Int J Ind Eng Comput 3(4):535–560

    Google Scholar 

  50. Rao RV, Kalyankar VD (2013) Parameter optimization of modern machining processes using teaching–learning-based optimization algorithm. Eng Appl Artif Intell 26(1):524–531

    Article  Google Scholar 

  51. Rao RV, Patel V (2013) An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems. Sci Iran 20(3):710–720

    Google Scholar 

  52. Rao RV, Savsani VJ, Vakharia DP (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315

    Article  Google Scholar 

  53. Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248

    Article  MATH  Google Scholar 

  54. Ray S, Bhattacharya A, Bhattacharjee S (2015) Optimal allocation of distributed generation and remote control switches for reliability enhancement of a radial distribution system using oppositional differential search algorithm. J Eng 2015(8):261–275

    Article  Google Scholar 

  55. Roy PK, Bhui S (2013) Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem. Int J Electr Power Energy Syst 53:937–948

    Article  Google Scholar 

  56. Roy PK, Sur A, Pradhan DK (2013) Optimal short-term hydro-thermal scheduling using quasi-oppositional teaching learning based optimization. Eng Appl Artif Intell 26(10):2516–2524

    Article  Google Scholar 

  57. Roy PK, Sarkar R (2014) Solution of unit commitment problem using quasi-oppositional teaching learning based algorithm. Int J Electr Power Energy Syst 60:96–106

    Article  Google Scholar 

  58. Roy PK, Paul C, Sultana S (2014) Oppositional teaching learning based optimization approach for combined heat and power dispatch. Int J Electr Power Energy Syst 57:392–403

    Article  Google Scholar 

  59. Sahu SR, Kanungo DP, Behera HS (2017) A modified fruit fly optimisation for classification of financial distress using FLANN. Int J Data Sci 2(2):155–172

    Article  Google Scholar 

  60. Satapathy SC, Naik A (2014) Modified teaching–learning-based optimization algorithm for global numerical optimization—a comparative study. Swarm Evol Comput 16:28–37

    Article  Google Scholar 

  61. Satapathy SC, Naik A, Parvathi K (2013) A teaching learning based optimization based on orthogonal design for solving global optimization problems. Springerplus 2(1):130

    Article  Google Scholar 

  62. Shao W, Pi D, Shao Z (2017) An extended teaching-learning based optimization algorithm for solving no-wait flow shop scheduling problem. Appl Soft Comput 61:193–210

    Article  Google Scholar 

  63. Shi M, Shen D, Nie T, Kou Y, Yu G (2018) HPPQ: a parallel package queries processing approach for large-scale data. Big Data Mining Anal 1(2):146–159

    Article  Google Scholar 

  64. Singh H, Kumar A, Balyan LK, Lee HN (2019) Fractional-order integration based fusion model for piecewise gamma correction along with textural improvement for satellite images. IEEE Access 7:37192–37210

    Article  Google Scholar 

  65. Soncco-Álvarez JL, Muñoz DM, Ayala-Rincón M (2019) Opposition-based memetic algorithm and hybrid approach for sorting permutations by reversals. Evol Comput 27(2):229–265

    Article  Google Scholar 

  66. Tomasiello S (2020) A granular functional network classifier for brain diseases analysis. Comput Methods Biomech Biomed Eng Imag Visual 8(4):382–388. https://doi.org/10.1080/21681163.2019.1627910

    Article  Google Scholar 

  67. Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  68. Sultana S, Roy PK (2014) Multi-objective quasi-oppositional teaching learning based optimization for optimal location of distributed generator in radial distribution systems. Int J Electr Power Energy Syst 63:534–545

    Article  Google Scholar 

  69. Tizhoosh HR (2005) Opposition-based learning: a new scheme for machine intelligence. In: International conference on computational intelligence for modelling, control and automation and international conference on intelligent agents, web technologies and internet commerce (CIMCA-IAWTIC'06) (vol 1, pp 695–701). IEEE

  70. Truong KH, Nallagownden P, Baharudin Z, Vo DN (2019) A quasi-oppositional-chaotic symbiotic organisms search algorithm for global optimization problems. Appl Soft Comput 77:567–583

    Article  Google Scholar 

  71. Waheeb W, Ghazali R (2019) A new genetically optimized tensor product functional link neural network: an application to the daily exchange rate forecasting. Evol Intel 12(4):593–608

    Article  Google Scholar 

  72. Waheeb W, Ghazali R (2019) A novel error-output recurrent neural network model for time series forecasting. Neural Comput Appl 1–27

  73. Wang H, Wu Z, Rahnamayan S, Liu Y, Ventresca M (2011) Enhancing particle swarm optimization using generalized opposition-based learning. Inf Sci 181(20):4699–4714

    Article  MathSciNet  Google Scholar 

  74. Wang WL, Li WK, Wang Z, Li L (2019) Opposition-based multi-objective whale optimization algorithm with global grid ranking. Neurocomputing 341:41–59

    Article  Google Scholar 

  75. Wei J, Yu Y (2017) An effective hybrid cuckoo search algorithm for unknown parameters and time delays estimation of chaotic systems. IEEE Access 6:6560–6571

    Article  Google Scholar 

  76. Xia K, Gao L, Wang L, Li W, Chao KM (2013) A simplified teaching-learning-based optimization algorithm for disassembly sequence planning. In: 2013 IEEE 10th international conference on e-business engineering. IEEE, pp 393–398

  77. Xu Q, Wang N, Zou F, Yang J (2019) Exploring the reasons behind the good performance of opposition-based learning. IEEE Access 7:7259–7272

    Article  Google Scholar 

  78. Yang XS (2010a) A new metaheuristic bat-inspired algorithm. In: Nature inspired cooperative strategies for optimization (NICSO 2010). Springer, Berlin, Heidelberg, pp 65–74

  79. Yang XS (2010b) Firefly algorithm, stochastic test functions and design optimisation. arXiv:1003.1409

  80. Yang XS, Deb S (2014) Cuckoo search: recent advances and applications. Neural Comput Appl 24(1):169–174

    Article  Google Scholar 

  81. Yanto ITR, Ismail MA, Herawan T (2016) A modified Fuzzy k-Partition based on indiscernibility relation for categorical data clustering. Eng Appl Artif Intell 53:41–52

    Article  Google Scholar 

  82. Ye X, Wang P, Xin G, Jin J, Huang Y (2019) Multi-scale quantum harmonic oscillator algorithm with truncated mean stabilization strategy for global numerical optimization problems. IEEE Access 7:18926–18939

    Article  Google Scholar 

  83. Yi J, Bai J, Zhou W, He H, Yao L (2017) Operating parameters optimization for the aluminum electrolysis process using an improved quantum-behaved particle swarm algorithm. IEEE Trans Ind Inf 14(8):3405–3415

    Article  Google Scholar 

  84. Zhang X, Wang D, Chen H (2019) Improved biogeography-based optimization algorithm and its application to clustering optimization and medical image segmentation. IEEE Access 7:28810–28825

    Article  Google Scholar 

  85. Zhou Y, Hao JK, Duval B (2017) Opposition-based memetic search for the maximum diversity problem. IEEE Trans Evol Comput 21(5):731–745

    Article  Google Scholar 

  86. Zou F, Wang L, Hei X, Chen D (2015) Teaching–learning-based optimization with learning experience of other learners and its application. Appl Soft Comput 37:725–736

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Sambalpur, Odisha, 768018, India

    Bighnaraj Naik & Pandit Byomakesha Dash

  2. Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), Tekkali, Andhra Pradesh, 532201, India

    Janmenjoy Nayak

Authors
  1. Bighnaraj Naik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Janmenjoy Nayak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pandit Byomakesha Dash
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Janmenjoy Nayak.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naik, B., Nayak, J. & Dash, P.B. Higher order ANN parameter optimization using hybrid opposition-elitism based metaheuristic. Evol. Intel. 15, 2055–2075 (2022). https://doi.org/10.1007/s12065-021-00610-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-021-00610-0

Keywords

Search

Navigation