Abstract
In this paper, software effort prediction (SEP) and software test prediction (STP) (i.e., software reliability problems) are tackled by integrating the salp swarm algorithm (SSA) with a backpropagation neural network (BPNN). Software effort and test prediction problems are common in software engineering and arise when seeking to determine the actual software resources needed to develop a project. BPNN is the most popular prediction algorithm used in the literature. The performance of BPNN depends totally on the initial parameter values such as weight and biases. The main objective of this paper is to integrate SSA with the BPNN to find the optimal weight for every training cycle and thereby improve prediction accuracy. The proposed method, abbreviated as SSA-BPNN, is tested on twelve SEP datasets and two STP datasets. All datasets vary in terms of complexity and size. The results obtained by SSA-BPNN are evaluated according to twelve performance measures: MSE, RMSE, RAE, RRSE, MAE, MRE, MMRE, MdMRE, VAF(%), R2(%), ED, and MD. First, the results obtained by BPNN with SSA (i.e., SSA-BPNN) and without SSA are compared. The evaluation of the results indicates that SSA-BPNN performs better than BPNN for all datasets. In the comparative evaluation, the results of SSA-BPNN are compared against thirteen state-of-the-art methods using the same SEP and STP problem datasets. The evaluation of the results reveals that the proposed method outperforms the comparative methods for almost all datasets, both SEP and STP, in the case of most performance measures. In conclusion, integrating SSA with BPNN is a very powerful approach for solving software reliability problems that can be used widely to yield accurate prediction results.
Similar content being viewed by others
References
Song Q, Shepperd M (2011) Predicting software project effort: A grey relational analysis based method. Expert Systems with Applications 38(6): 7302–7316
Schwalbe K (2015) Information technology project management, 8th Edition, Cengage Learning: Boston
Okoh C, Roy R, Mehnen J, Redding L (2014) Overview of remaining useful life prediction techniques in through-life engineering services. Procedia Cirp 16: 158–163
Xiongzi C, Jinsong Y, Diyin T, Yingxun W (2011) Remaining useful life prognostic estimation for aircraft subsystems or components: A review, in: IEEE 2011 10th International Conference on Electronic Measurement & Instruments, Vol. 2, IEEE, pp 94–98
Yang S, Liu C, Zhou X, Liang W, Miao Q (2012) Investigation on data-driven life prediction methods, In: 2012 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering, IEEE, pp 674–680
Ahmad MW, Mourshed M, Yuce B, Rezgui Y (2016) Computational intelligence techniques for hvac systems: A review, in: Building Simulation, Vol. 9, Springer, pp 359–398
Bocheng Z, Kuo L, Dinghao L, Jing L, Xuan F (2015) Short-term prediction of building energy consumption based on galm neural network, in: International Conference on Advances in Mechanical Engineering and Industrial Informatics (AMEII), pp 867–71
Kumar R, Aggarwal R, Sharma J (2013) Energy analysis of a building using artificial neural network: A review, Energy and Buildings 65: 352–358
Ekici BB, Aksoy UT (2009) Prediction of building energy consumption by using artificial neural networks. Advances in Engineering Software 40(5): 356–362
Azadeh A, Ghaderi S, Sohrabkhani S (2008) Annual electricity consumption forecasting by neural network in high energy consuming industrial sectors, Energy Conversion and management 49(8): 2272–2278
Dosdoğru AT, Boru A, Göçken M, ÖZÇALICI M, Göçken T Assessment of hybrid artificial neural networks and metaheuristics for stock market forecasting. Journal of the Cukurova University Institute of Social Sciences 27 (1)
Göçken M, Özçalıcı M, Boru A, Dosdoğru AT (2019) Stock price prediction using hybrid soft computing models incorporating parameter tuning and input variable selection. Neural Computing and Applications 31(2): 577–592
Abusnaina AA, Ahmad S, Jarrar R, Mafarja M (2018) Training neural networks using salp swarm algorithm for pattern classification. In: Proceedings of the 2nd International Conference on Future Networks and Distributed Systems, ACM, p 17
A. Ahmadian, A. Elkamel, A. Mazouz, An improved hybrid particle swarm optimization and tabu search algorithm for expansion planning of large dimension electric distribution network, Energies 12 (16) (2019) 3052
Alweshah M, Al-Daradkeh A, Al-Betar MA, Almomani A, Oqeili S (2019) beta-hill climbing algorithm with probabilistic neural network for classification problems, Journal of Ambient Intelligence and Humanized Computing 11: 3405–3416
Van Laarhoven PJ, Aarts EH (1987) Simulated annealing, in: Simulated annealing: Theory and applications (pp 7–15). Springer: Berlin
Glover F, Laguna M (1998) Tabu search. In: Handbook of combinatorial optimization (pp 2093–2229). Springer: Berlin
Al-Betar MA (2017) beta-hill climbing: an exploratory local search. Neural Computing and Applications 28(1): 153–168
Schneider M, Stenger A, Hof J (2015) An adaptive vns algorithm for vehicle routing problems with intermediate stops. Or Spectrum 37(2): 353–387
Rajkumar M, Asokan P, Anilkumar N, Page T (2011) A grasp algorithm for flexible job-shop scheduling problem with limited resource constraints. International Journal of Production Research 49(8): 2409–2423
Cheng S, Liu B, Ting T, Qin Q, Shi Y, Huang K (2016) Survey on data science with population-based algorithms, Big Data Analytics 1(1): 1–20
Yilmaz S (2020) Electric fish optimization: A new heuristic algorithm based on electrolocation, Ph.D. thesis, Fen Bilimleri Enstitüsü
Sheta AF (2006) Estimation of the cocomo model parameters using genetic algorithms for nasa software projects. Journal of Computer Science 2(2): 118–123
Chhabra S, Singh H (2020) Optimizing design of fuzzy model for software cost estimation using particle swarm optimization algorithm. International Journal of Computational Intelligence and Applications 19(01): 2050005
Sheta A, Aljahdali S, Braik M (2018) Utilizing faults and time to finish estimating the number of software test workers using artificial neural networks and genetic programming, in: International Conference Europe Middle East & North Africa Information Systems and Technologies to Support Learning, Springer, pp 613–624
Kumar A, Gupta A, Jain A, Farma V (2020) Comparative study on swarm based algorithms for feature reduction in twitter sentiment analysis on figurative language, In: Future of Information and Communication Conference, Springer, pp 1–16
Shah MA, Jawawi DNA, Isa MA, Younas M, Abdelmaboud A, Sholichin F (2020) Ensembling artificial bee colony with analogy-based estimation to improve software development effort prediction. IEEE Access 8: 58402–58415
Yousef QM, Alshaer YA, Alhammad NK (2017) Dragonfly estimator: a hybrid software projects’ efforts estimation model using artificial neural network and dragonfly algorithm. Int J Comput Sci Netw Secur 17(9): 108–120
Ghatasheh N, Faris H, Aljarah I, Al-Sayyed RM (2019) Optimizing software effort estimation models using firefly algorithm, arXiv preprint 8(3): 133–142
Resmi V, Vijayalakshmi S, Chandrabose RS (2019) An effective software project effort estimation system using optimal firefly algorithm. Cluster Computing 22(5): 11329–11338
Reddy DKK, Behera H (2020) Software effort estimation using particle swarm optimization: Advances and challenges. In: Computational Intelligence in Pattern Recognition, Springer, pp 243–258
Fadhil AA, Alsarraj RG, Altaie AM (2020) Software cost estimation based on dolphin algorithm. IEEE Access 8: 75279–75287
Sheta AF, Abdel-Raouf A Estimating the parameters of software reliability growth models using the grey wolf optimization algorithm, IJACSA). International Journal of Advanced Computer Science and Applications 7(4)
Al Nsour H, Alweshah M, Hammouri AI, Al Ofeishat H, Mirjalili S (2020) A hybrid grey wolf optimiser algorithm for solving time series classification problems. Journal of Intelligent Systems 29(1): 846–857
Jaddi NS, Abdullah S (2017) A cooperative-competitive master-slave global-best harmony search for ann optimization and water-quality prediction. Applied Soft Computing 51: 209–224
Jaddi NS, Abdullah S (2019) Kidney-inspired algorithm with reduced functionality treatment for classification and time series prediction, PloS one 14(1): 0208308
Jaddi NS, Abdullah S (2019) Kidney-inspired algorithm with reduced functionality treatment for classification and time series prediction. PloS one 14(1): 0208308
Jaddi NS, Abdullah S, Abdul Malek M (2017) Master-leader-slave cuckoo search with parameter control for ann optimization and its real-world application to water quality prediction, PloS one 12(1): 0170372
Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris S, Mirjalili SM (2017) Salp swarm algorithm: A bio-inspired optimizer for engineering design problems. Advances in Engineering Software 114: 163–191
Abbassi A, Abbassi R, Heidari AA, Oliva D, Chen H, Habib A, Jemli M, Wang M (2020) Parameters identification of photovoltaic cell models using enhanced exploratory salp chains-based approach. Energy 198: 117333
Tubishat M, Idris N, Shuib L, Abushariah MA, Mirjalili S (2020) Improved salp swarm algorithm based on opposition based learning and novel local search algorithm for feature selection. Expert Systems with Applications 145: 113–122
Zhang H, Cai Z, Ye X, Wang M, Kuang F, Chen H, Li C, Li Y (2020) A multi-strategy enhanced salp swarm algorithm for global optimization. Engineering with Computers 1–27
Wu J, Nan R, Chen L (2019) Improved salp swarm algorithm based on weight factor and adaptive mutation, Journal of Experimental & Theoretical Artificial Intelligence 31(3): 493–515
Wang S, Jia H, Peng X (2020) Modified salp swarm algorithm based multilevel thresholding for color image segmentation. Math Biosci Eng 17: 700–724
Zhang L, Li C, Wu Y, Huang J, Cui Z (2020) An improved salp swarm algorithm with spiral flight search for optimizing hybrid active power filters parameters. IEEE Access 8: 154816–154832
Zhang J, Wang J (2020) Improved salp swarm algorithm based on levy flight and sine cosine operator, IEEE Access 8: 99740–99771
Xing Z, Jia H (2019) Multilevel color image segmentation based on glcm and improved salp swarm algorithm. IEEE Access 7: 37672–37690
Ma B, Ni H, Zhu X, Zhao R (2019) A comprehensive improved salp swarm algorithm on redundant container deployment problem. IEEE Access 7: 136452–136470
Mahmoud K, Abdel-Nasser M, Mustafa E, Ali ZM (2020) Improved salp-swarm optimizer and accurate forecasting model for dynamic economic dispatch in sustainable power systems. Sustainability 12(2): 576
Abualigah L, Shehab M, Alshinwan M, Alabool H (2019) Salp swarm algorithm: a comprehensive survey. Neural Computing and Applications 1–21
Asaithambi S, Rajappa M (2018) Swarm intelligence-based approach for optimal design of cmos differential amplifier and comparator circuit using a hybrid salp swarm algorithm. Review of Scientific Instruments 89(5): 054702
Ekinci S, Hekimoglu B (2018) Parameter optimization of power system stabilizer via salp swarm algorithm. In: 2018 5th International Conference on Electrical and Electronic Engineering (ICEEE), IEEE, pp 143–147
Kassaymeh S, Abdullah S, Al-Betar MA, Alweshah M (2021) Salp swarm optimizer for modeling the software fault prediction problem. Journal of King Saud University-Computer and Information Sciences
El-Fergany AA (2018) Extracting optimal parameters of pem fuel cells using salp swarm optimizer. Renewable Energy 119: 641–648
Faris H, Mafarja MM, Heidari AA, Aljarah I, Ala’M A-Z, Mirjalili S, Fujita H (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowledge-Based Systems 154: 43–67
Ibrahim RA, Ewees AA, Oliva D, Elaziz MA, Lu S (2018) Improved salp swarm algorithm based on particle swarm optimization for feature selection. Journal of Ambient Intelligence and Humanized Computing 1–15
Khamees M, Albakry A, Shaker K (2018) Multi-objective feature selection: Hybrid of salp swarm and simulated annealing approach. In: International Conference on New Trends in Information and Communications Technology Applications, Springer, pp 129–142
Sayed GI, Khoriba G, Haggag MH (2018) A novel chaotic salp swarm algorithm for global optimization and feature selection, Applied Intelligence 48(10): 3462–3481
Alweshah M, Rababa L, Ryalat MH, Al Momani A, Ababneh MF (2020) African buffalo algorithm: Training the probabilistic neural network to solve classification problems. Journal of King Saud University-Computer and Information Sciences
Alweshah M, Ramadan E, Ryalat MH, Almi’ani M, Hammouri AI (2020) Water evaporation algorithm with probabilistic neural network for solving classification problems, Jordanian Journal of Computers and Information Technology (JJCIT) 6(01)
Alweshah M, Qadoura MA, Hammouri AI, Azmi MS, AlKhalaileh S (2020) Flower pollination algorithm for solving classification problems. Int J Advance Soft Comput Appl 12(1)
Alweshah M, Al-Sendah M, Dorgham OM, Al-Momani A, Tedmori S (2020) Improved water cycle algorithm with probabilistic neural network to solve classification problems. Cluster Computing 1–16
Alweshah M (2019) Construction biogeography-based optimization algorithm for solving classification problems. Neural Computing and Applications 31(10): 5679–5688
Hussien AG, Hassanien AE, Houssein EH (2017) Swarming behaviour of salps algorithm for predicting chemical compound activities, in: 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS), IEEE, pp 315–320
Wang J, Gao Y, Chen X (2018) A novel hybrid interval prediction approach based on modified lower upper bound estimation in combination with multi-objective salp swarm algorithm for short-term load forecasting. Energies 11(6): 1561
Ibrahim A, Ahmed A, Hussein S, Hassanien AE (2018) Fish image segmentation using salp swarm algorithm, in: International Conference on Advanced Machine Learning Technologies and Applications (pp 42–51). Springer: Berlin
Zhang J, Wang Z, Luo X (2018) Parameter estimation for soil water retention curve using the salp swarm algorithm, Water 10(6): 815
Abbassi R, Abbassi A, Heidari AA, Mirjalili S (2019) An efficient salp swarm-inspired algorithm for parameters identification of photovoltaic cell models, Energy Conversion and Management 179: 362–372
Barik AK, Das DC (2018) Active power management of isolated renewable microgrid generating power from rooftop solar arrays, sewage waters and solid urban wastes of a smart city using salp swarm algorithm. In: 2018 Technologies for Smart-City Energy Security and Power (ICSESP), IEEE, pp 1–6
Guha D, Roy P, Banerjee S (2019) A maiden application of salp swarm algorithm optimized cascade tilt-integral-derivative controller for load frequency control of power systems, IET Generation, Transmission and Distribution 13(7): 1110–1120
Tohma Y, Tokunaga K, Nagase S, Murata Y (1989) Structural approach to the estimation of the number of residual software faults based on the hyper-geometric distribution. IEEE Transactions on Software Engineering 15(3): 345–355
Sheta AF, Kassaymeh S, Rine D (2014) Estimating the number of test workers necessary for a software testing process using artificial neural networks. IJACSA 5(7): 186–192
Jorgensen M, Shepperd M (2006) A systematic review of software development cost estimation studies, IEEE Transactions on software engineering 33(1): 33–53
Nassif AB, Azzeh M, Idri A, Abran A (2019) Software development effort estimation using regression fuzzy models. Computational Intelligence and Neuroscience
Heemstra FJ (1992) Software cost estimation. Information and software technology 34(10): 627–639
Azzeh M, Nassif AB, Banitaan S (2017) Comparative analysis of soft computing techniques for predicting software effort based use case points. IET Software 12(1): 19–29
Lopez-Martin C, Yáñez-Márquez C, Gutierrez-Tornes A (2006) A fuzzy logic model for software development effort estimation at personal level, in: Mexican International Conference on Artificial Intelligence, Springer, pp 122–133
Silhavy R, Silhavy P, Prokopova Z (2017) Analysis and selection of a regression model for the use case points method using a stepwise approach. Journal of Systems and Software 125: 1–14
Malhotra R, Khanna M (2018) Particle swarm optimization-based ensemble learning for software change prediction. Information and Software Technology 102: 65–84
Kumar L, Rath SK (2017) Software maintainability prediction using hybrid neural network and fuzzy logic approach with parallel computing concept. International Journal of System Assurance Engineering and Management 8(2): 1487–1502
Kumar L, Rath SK (2016) Hybrid functional link artificial neural network approach for predicting maintainability of object-oriented software. Journal of Systems and Software 121: 170–190
Zhang W, Huang L, Ng V, Ge J (2015) Smplearner: learning to predict software maintainability. Automated Software Engineering 22(1): 111–141
Basgalupp MP, Barros RC, Ruiz DD (2012) Predicting software maintenance effort through evolutionary-based decision trees. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing, pp 1209–1214
Malhotra R, Jain A (2011) Software effort prediction using statistical and machine learning methods. International Journal of Advanced Computer Science and Applications 2(1): 145–152
Yoon I-C, Sussman A, Memon A, Porter A (2008) Effective and scalable software compatibility testing. In: Proceedings of the 2008 international symposium on Software testing and analysis, ACM, pp 63–74
Wang Y,Wang L, Chang Q, Yang C (2019) Effects of direct input-output connections on multilayer perceptron neural networks for time series prediction. Soft Computing 1–10
Li X, Jiang Q, Hsu MK, Chen Q (2019) Support or risk? software project risk assessment model based on rough set theory and backpropagation neural network. Sustainability 11(17): 4513
Hecht-Nielsen R (1992) Theory of the backpropagation neural network. In: Neural networks for perception. Elsevier, Amsterdam, pp 65–93
Felipe NF, Cavalcanti RP, Maia EHB, Amaral WP, Farnese AC, Tavares LD, de Faria ESJ, da Silva CIP, de Pádua Paula Filho W, et al. (2019) A comparative study of three test effort estimation methods, Revista Cubana de Ciencias Informáticas 8
Ren C, An N, Wang J, Li L, Hu B, Shang D (2014) Optimal parameters selection for bp neural network based on particle swarm optimization: A case study of wind speed forecasting, Knowledge-based systems 56: 226–239
Sun W, Huang C (2020) A carbon price prediction model based on secondary decomposition algorithm and optimized back propagation neural network. Journal of Cleaner Production 243: 118671
Coello CAC, Pulido GT, Lechuga MS (2004) Handling multiple objectives with particle swarm optimization. IEEE Transactions on evolutionary computation 8(3): 256–279
Rumelhart DE, Durbin R, Golden R, Chauvin Y (1995) Backpropagation: The basic theory, Backpropagation: Theory, architectures and applications 1–34
Hornik K, Stinchcombe M, White H et al. (1989) Multilayer feedforward networks are universal approximators. Neural Networks 2(5): 359–366
Wittek P (2014) Pattern recognition and neural networks. Quantum Machine Learning 63–71
Hecht-Nielsen R (1987) Kolmogorov’s mapping neural network existence theorem. In: Proceedings of the international conference on Neural Networks, Vol. 3, IEEE Press New York, pp 11–14
Shivhare J, Rath SK (2014) Software effort estimation using machine learning techniques. In: Proceedings of the 7th India Software Engineering Conference, pp 1–6
Shivhare K et al. (2014) Effectiveness of feature selection and machine learning techniques for software effort estimation, Ph.D. thesis
Wen S, Xiao S, Yang Y, Yan Z, Zeng Z, Huang T (2018) Adjusting learning rate of memristor-based multilayer neural networks via fuzzy method, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 38(6): 1084–1094
Abbas Q, Ahmad F, Imran M (2016) Variable learning rate based modification in backpropagation algorithm (mbpa) of artificial neural network for data classification. Science International 28(3)
Mensah S, Keung J, Bosu MF, Bennin KE (2018) Duplex output software effort estimation model with self-guided interpretation. Information and Software Technology 94: 1–13
Azzeh M Dataset quality assessment: An extension for analogy based effort estimation, arXiv preprint arXiv:1703.04575
Kirsopp C, Shepperd M (2003) Case and feature subset selection in case-based software project effort prediction, In: Research and Development in Intelligent Systems XIX, Springer, pp 61–74
Kirsopp C, Shepperd MJ, Hart J (2002) Search heuristics, case-based reasoning and software project effort prediction. In: GECCO 2002 Genetic and Evolutionary Computation Conference AAAI, Morgan Kaufmann Publishers Inc.,
Keung JW, Kitchenham BA, Jeffery DR (2008) Analogy-x: providing statistical inference to analogy-based software cost estimation, IEEE Transactions on Software Engineering 34(4): 471–484
Sehra SK, Brar YS, Kaur N, Sehra SS (2019) Software effort estimation using fahp and weighted kernel lssvm machine. Soft Computing 23(21): 10881–10900
Sree SR, Rao CP (2020) A study on application of soft computing techniques for software effort estimation. In: A Journey Towards Bio-inspired Techniques in Software Engineering, Springer, pp 141–165
Kaushik A, Choudhary N et al (2021) Software cost estimation using lstm-rnn, in: Proceedings of International Conference on Artificial Intelligence and Applications, Springer, pp 15–24
Jiang J, Chen Z, Wang Y, Peng T, Zhu S, Shi L (2020) Parameter estimation for pmsm based on a back propagation neural network optimized by chaotic artificial fish swarm algorithm, International Journal of Computers Communications and Control 14(6): 615–632
Hu C, Zhao F (2010) Improved methods of bp neural network algorithm and its limitation. In: 2010 International Forum on Information Technology and Applications, Vol. 1, IEEE, pp 11–14
Hashemi SMR, Kozegar E, Deramgozin MM, Minaei-Bidgoli B (2018) Training feed-forward neural networks using asexual reproduction optimization (aro) algorithm. In: 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI), IEEE, pp 809–812
Shen X, Zheng Y, Zhang R (2020) A hybrid forecasting model for the velocity of hybrid robotic fish based on back-propagation neural network with genetic algorithm optimization. IEEE Access 8: 111731–111741
Sheta AF, Rine D, Kassaymeh S (2015) Software effort and function points estimation models based radial basis function and feedforward artificial neural networks, International Journal of Next-Generation Computing 6(3): 192–205
Acknowledgements
This work was supported in part by the Ministry of Higher Education, Malaysia, under Grant FRGS /1/2019/ICT02/UKM/01/1, and in part by the Universiti Kebangsaan Malaysia under Grant DIP-2016-024.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kassaymeh, S., Abdullah, S., Al-Laham, M. et al. Salp Swarm Optimizer for Modeling Software Reliability Prediction Problems. Neural Process Lett 53, 4451–4487 (2021). https://doi.org/10.1007/s11063-021-10607-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-021-10607-6