Abstract
Parameter identification for complex systems of nonlinear nature is challenging due to the complicated process structure and large number of parameters with different identifiability. The scope of this work is to develop a model-based parameter identification method for a nonlinear industrial winding system. The proposed parameter identification method consists of two key steps: First, enhanced whale optimization algorithm (EWOA) was proposed to alleviate the issues of low search performance and premature convergence of WOA, for which the following enhancements were made to WOA: (1) improvements to the bubble-net strategy of its mathematical model, (2) amendments to the humpback whales’ movements in the direction of the best whales, and (3) imitation of the schooling behavior of humpback whales when chasing prey. Second, EWOA was acted as a training method for artificial neural networks (ANNs)-type multilayer perceptron (MLP), a method referred to as EWOA-MLP. In this, EWOA was applied to train ANNs in order to mitigate the main difficulties of ANNs due to their nonlinear nature and unknown optimal set of control parameters (i.e., weights and biases). The performance of the proposed EWOA-MLP was assessed in modeling the subsystems of the winding process under study and in solving fifteen classification datasets. The effectiveness of EWOA-MLP in both modeling and classification studies was judged by several pertinent assessment metrics. Results of comparison of the proposed EWOA-MLP with other promising methods firmly confirm the promising performance of EWOA-MLP for both local optima avoidance and convergence rate, proving its value and superiority. Moreover, EWOA-MLP was able to outperform other algorithms in modeling the winding process and solving many classification problems.
Similar content being viewed by others
Availability of data and materials
The data that support the findings of this study are available on request from the corresponding author.
References
Al-Azzeh J, Alqadi Z, Abuzalata M (2019) Performance analysis of artificial neural networks used for color image recognition and retrieving. Int J Comput Sci Mobile Comput 8(2)
Arunkumar N, Mohammed MA, Mostafa SA, Ibrahim DA, Rodrigues JJ, de Albuquerque VHC (2020) Fully automatic model-based segmentation and classification approach for mri brain tumor using artificial neural networks. Concurr Comput Pract Exp 32(1):e4962
Chang P-C, Wu J-L, Xu Y, Zhang M, Lu X-Y (2019) Bike sharing demand prediction using artificial immune system and artificial neural network. Soft Comput 23(2):613–626
Wang Z, Rosen D (2022) Manufacturing process classification based on heat kernel signature and convolutional neural networks. J Intell Manuf 1–23
Refonaa J, Huy DTN, Trung ND, Van Thuc H, Raj R, Haq MA, Kumar A (2022) Probabilistic methods and neural networks in structural engineering. Int J Adv Manuf Technol 1–9
Saritas MM, Yasar A (2019) Performance analysis of ann and naive bayes classification algorithm for data classification. Int J Intell Syst Appl Eng 7(2):88–91
Zhang L, Gao T, Cai G, Hai KL (2022) Research on electric vehicle charging safety warning model based on back propagation neural network optimized by improved gray wolf algorithm. J Energy Storage 49:104092
Faris H, Aljarah I, Mirjalili S (2016) Training feedforward neural networks using multi-verse optimizer for binary classification problems. Appl Intell 45(2):322–332
Braik M, Al-Zoubi H, Ryalat M, Sheta A, Alzubi O (2023) Memory based hybrid crow search algorithm for solving numerical and constrained global optimization problems. Artif Intell Rev 56(1):27–99
Bacanin N, Alhazmi K, Zivkovic M, Venkatachalam K, Bezdan T, Nebhen J (2022) Training multi-layer perceptron with enhanced brain storm optimization metaheuristics. Comput Materials Contin 70(2):4199–4215
Braik M (2021) A hybrid multi-gene genetic programming with capuchin search algorithm for modeling a nonlinear challenge problem: Modeling industrial winding process, case study. Neural Process Lett 53(4):2873–2916
Rojas MG, Olivera AC, Vidal PJ (2022) Optimising multilayer perceptron weights and biases through a cellular genetic algorithm for medical data classification. Array 14:100173
Tian Z, Gan W, Zou X, Zhang Y, Gao W (2022) Performance prediction of a cryogenic organic rankine cycle based on back propagation neural network optimized by genetic algorithm. Energy 254:124027
Movassagh AA, Alzubi JA, Gheisari M, Rahimi M, Mohan S, Abbasi AA, Nabipour N (2021) Artificial neural networks training algorithm integrating invasive weed optimization with differential evolutionary model. J Ambient Intell Humaniz Comput 1–9
Zhang Y, Wang S, Ji G (2015) A comprehensive survey on particle swarm optimization algorithm and its applications. Math Probl Eng 2015
Xu F, Pun C-M, Li H, Zhang Y, Song Y, Gao H (2020) Training feed-forward artificial neural networks with a modified artificial bee colony algorithm. Neurocomputing 416:69–84
Khan A, Shah R, Imran M, Khan A, Bangash JI, Shah K (2019) An alternative approach to neural network training based on hybrid bio meta-heuristic algorithm. J Ambient Intell Humaniz Comput 10(10):3821–3830
Braik M, Al-Zoubi H, Al-Hiary H (2021) Artificial neural networks training via bio-inspired optimisation algorithms: modelling industrial winding process, case study. Soft Comput 25:4545–4569
Al-Betar MA, Awadallah MA, Doush IA, Alomari OA, Abasi AK, Makhadmeh SN, Alyasseri ZAA (2022) Boosting the training of neural networks through hybrid metaheuristics. Cluster Comput 1–23
Awadallah MA, Abu-Doush I, Al-Betar MA, Braik MS (2023) Metaheuristics for optimizing weights in neural networks. In: Comprehensive Metaheuristics. Elsevier, pp 359–377
Ho Y-C, Pepyne DL (2002) Simple explanation of the no-free-lunch theorem and its implications. J Optim Theory Appl 115(3):549–570
Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Gharehchopogh FS, Gholizadeh H (2019) A comprehensive survey: whale optimization algorithm and its applications. Swarm Evol Comput 48:1–24
Braik M (2022) Hybrid enhanced whale optimization algorithm for contrast and detail enhancement of color images. Cluster Comput 1–37
Braik M, Sheta A, Al-Hiary H, Aljahdali S (2022) Enhanced cuckoo search algorithm for industrial winding process modeling. J Intell Manuf 1–30
Sheta A, Braik M, Al-Hiary H (2019) Modeling the tennessee eastman chemical process reactor using bio-inspired feedforward neural network (bi-ff-nn). Int J Adv Manuf Technol 1–22
Sheta A F, Braik M, Öznergiz E, Ayesh A, Masud M (2013) Design and automation for manufacturing processes: An intelligent business modeling using adaptive neuro-fuzzy inference systems. Bus Intell Perform Manag, Springer, pp 191–208
Khosravi A, Koury R, Machado L, Pabon J (2018) Prediction of wind speed and wind direction using artificial neural network, support vector regression and adaptive neuro-fuzzy inference system. Sustain Energy Technol Assess 25:146–160
Hussian A, Sheta A, Kamel M, Telbaney M, Abdelwahab A (2000) Modeling of a winding machine using genetic programming. In: Evolutionary Computation, Proceedings of the 2000 Congress on IEEE 1:398–402
Noura H, Theilliol D, Ponsart J-C, Chamseddine A (2009) Fault-tolerant control systems: design and practical applications. Springer Science & Business Media
Nozari HA, Banadaki HD, Mokhtare M, Vahed SH (2012) Intelligent non-linear modelling of an industrial winding process using recurrent local linear neuro-fuzzy networks. J Zhejiang Univ SCIENCE C 13(6):403–412
Sadati N, Chinnam RB, Nezhad MZ (2018) Observational data-driven modeling and optimization of manufacturing processes. Expert Syst Appl 93:456–464
Torres PJR, Mercado ES, Rifón LA (2018) Probabilistic boolean network modeling of an industrial machine. J Intell Manuf 29(4):875–890
Wang Y, Li H, Qi C (2020) An adaptive mode convolutional neural network based on bar-shaped structures and its operation modeling to complex industrial processes. Chemom Intell Lab Syst, p 103932
Ye Z, Kim MK (2018) Predicting electricity consumption in a building using an optimized back-propagation and levenberg-marquardt back-propagation neural network: Case study of a shopping mall in china. Sustain Cities Soc 42:176–183
Zingg DW, Nemec M, Pulliam TH (2008) A comparative evaluation of genetic and gradient-based algorithms applied to aerodynamic optimization. Eur J Comput Mech 17(1–2):103–126
Nikabadi M, Naderi R (2016) A hybrid algorithm for unrelated parallel machines scheduling. Int J Ind Eng Comput 7(4):681–702
Ayough A, Khorshidvand B (2019) Designing a manufacturing cell system by assigning workforce. J Ind Eng Manag 12(1):13–26
Mousavi SH, Nazemi A, Hafezalkotob A (2015) Using and comparing metaheuristic algorithms for optimizing bidding strategy viewpoint of profit maximization of generators. J Ind Eng Int 11(1):59–72
Dixit SR, Das SR, Dhupal D (2019) Parametric optimization of nd: Yag laser microgrooving on aluminum oxide using integrated rsm-ann-ga approach. J Ind Eng Int 15(2):333–349
Dao SD, Abhary K, Marian R (2017) Optimisation of assembly scheduling in vcim systems using genetic algorithm. J Ind Eng Int 13(3):275–296
Moslemipour G (2018) A hybrid cs-sa intelligent approach to solve uncertain dynamic facility layout problems considering dependency of demands. J Ind Eng Int 14(2):429–442
Yıldız AR (2008) Hybrid taguchi-harmony search algorithm for solving engineering optimization problems. Int J Ind Eng 15(3):286–293
Sun K, Huang S-H, Wong DS-H, Jang S-S (2016) Design and application of a variable selection method for multilayer perceptron neural network with lasso. IEEE Trans Neural Netw Learn Syst 28(6):1386–1396
Bastogne T, Noura H, Sibille P, Richard A (1998) Multivariable identification of a winding process by subspace methods for tension control. Control Eng Pract 6(9):1077–1088
Mosavi A, Shirzadi A, Choubin B, Taromideh F, Hosseini FS, Borji M, Shahabi H, Salvati A, Dineva AA (2020) Towards an ensemble machine learning model of random subspace based functional tree classifier for snow avalanche susceptibility mapping. IEEE Access 8:145–968
Owusu P (2020) Microstrip butterworth lowpass filter design
Wdaa ASI, Sttar A (2008) Differential evolution for neural networks learning enhancement. In: Ph.D. Dissertation, Universiti Teknologi Malaysia Johor Bahru
Mirjalili S, Mirjalili SM, Lewis A (2014) Let a biogeography-based optimizer train your multi-layer perceptron. Inf Sci 269:188–209
Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47
Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat, pp 65–70
Cano J-R, García S, Herrera F (2008) Subgroup discover in large size data sets preprocessed using stratified instance selection for increasing the presence of minority classes. Pattern Recogn Lett 29(16):2156–2164
Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249
Mirjalili S (2016) Sca: a sine cosine algorithm for solving optimization problems. Knowl Based Syst 96:120–133
Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017) Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
Braik M, Sheta A, Al-Hiary H (2021) A novel meta-heuristic search algorithm for solving optimization problems: capuchin search algorithm. Neural Comput Appl 33:2515–2547
Kennedy J, Eberhart R (1995) Particle swarm optimization (pso). In: Proceedings of IEEE International Conference on Neural Networks, Perth, Australia, pp 1942–1948
Braik M, Hammouri A, Atwan J, Al-Betar MA, Awadallah MA (2022) White shark optimizer: a novel bio-inspired meta-heuristic algorithm for global optimization problems. Knowl-Based Syst 243:108457
Pereira DG, Afonso A, Medeiros FM (2015) Overview of friedman’s test and post-hoc analysis. Commun Stat Simul Comput 44(10):2636–2653
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
The authors confirm contribution to the paper as follows: Study conception and design: Malik Braik; Data collection: Heba Al-Hiary; Design Methodology: Malik Braik, Heba Al-Hiary; Statistical analysis and interpretation of the results: Malik Braik, Mohammed Awadallah, Mohammed Azmi Al-Betar; Draft manuscript preparation: Malik Braik. All authors reviewed the results and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Braik, M., Awadallah, M., Al-Betar, M.A. et al. Enhanced whale optimization algorithm-based modeling and simulation analysis for industrial system parameter identification. J Supercomput 79, 14489–14544 (2023). https://doi.org/10.1007/s11227-023-05215-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-023-05215-1