Abstract
Metaheuristics have been very successful in solving difficult optimization problems by employing randomness in their search mechanism. They find near-optimal solutions in reasonable amount of computation time and resources. Testing of metaheuristics is performed by computing descriptive statistics as well as by comparative testing with other State-of-the-art methods. However, performance guarantees for Metaheuristics are not provided, which limits its commercial potential. An attempt has been made in this paper to propose a framework for Performance Testing of Metaheuristics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
S. Shan, G.G. Wang, Struct. Multidisc. Optim. 41, 219 (2010). https://doi.org/10.1007/s00158-009-0420-2
C. Blum, A. Roli, Hybrid metaheuristics: an introduction, in Hybrid Metaheuristics. Studies in Computational Intelligence, vol 114, ed. by C. Blum, M.J.B. Aguilera, A. Roli, M. Sampels (Springer, Berlin, Heidelberg, 2008)
A. Nakib, P. Siarry, Performance analysis of dynamic optimization algorithms, in Metaheuristics for Dynamic Optimization. Studies in Computational Intelligence, vol. 433, ed. by E. Alba, A. Nakib, P. Siarry (Springer, Berlin, Heidelberg, 2013)
M.-H. Lin, J.-F. Tsai, C.-S. Yu, A review of deterministic optimization methods in engineering and management. Math. Problems Eng. 2012 (2012)
B. Sarasola, E. Alba, Quantitative performance measures for dynamic optimization problems, in Metaheuristics for Dynamic Optimization. Studies in Computational Intelligence, vol. 433, ed. by E. Alba, A. Nakib, P. Siarry (Springer, Berlin, Heidelberg, 2013)
I. Boussaïd, J. Lepagnot, P. Siarry, A survey on optimization metaheuristics. Inf. Sci. 237, 82–117 ISSN 0020-0255 (2013). https://doi.org/10.1016/j.ins.2013.02.041. http://www.sciencedirect.com/science/article/pii/S0020025513001588
K. Hussain, M.N. Mohd Salleh, S. Cheng et al., Artif. Intell. Rev. 52, 2191 (2019). https://doi.org/10.1007/s10462-017-9605-z
M. Issa, A.E. Hassanien, I. Ziedan, Performance evaluation of sine-cosine optimization versus particle swarm optimization for global sequence alignment problem, in Machine Learning Paradigms: Theory and Application. Studies in Computational Intelligence, vol. 801, ed. by A. Hassanien (Springer, Cham, 2019)
N.H. Awad, M.Z. Ali, J.J. Liang, B.Y. Qu, P.N. Suganthan, Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective bound constrained real-parameter numerical optimization. Technical Report, Nanyang Technological University, Singapore, Nov 2016
S. GarcÃa, D. Molina, M. Lozano et al., J. Heuristics, A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC 2005 special session on real parameter optimization. 15:617 (2009). https://doi.org/10.1007/s10732-008-9080-4
S. Weerahandi, Generalized confidence intervals, in Exact Statistical Methods for Data Analysis. Springer Series in Statistics (Springer, New York, NY, 1995)
D.C. Montgomery, G.C. Runger, in Applied Statistics and Probability for Engineers, 5th edn. (Wiley, 2011), 765 pp
L. Rajashekharan, C. Shunmuga Velayutham, Is differential evolution sensitive to pseudo random number generator quality?—an investigation, in Intelligent Systems Technologies and Applications. Advances in Intelligent Systems and Computing, vol. 384, ed. by S. Berretti, S. Thampi, P. Srivastava (Springer, Cham, 2016)
H. Fischer, A history of the central limit theorem: from classical to modern probability theory, in Sources and Studies in the History of Mathematics and Physical Sciences (Springer, New York, 2011). https://doi.org/10.1007/978-0-387-87857-7
N. Mani, Gursaran, A.K. Sinha, A. Mani, Taguchi-based tuning of rotation angles and population size in quantum-inspired evolutionary algorithm for solving MMDP, in Proceedings of the Second International Conference on Soft Computing for Problem Solving (SocProS 2012), December 28–30, 2012. Advances in Intelligent Systems and Computing, vol. 236, ed. by B. Babu et al. (Springer, New Delhi, 2014)
R. Cacoullous, Estimation of a probability density. Ann. Inst. Stat. Math. (Tokyo) 18(2), 179–189 (1966)
J. Brest, M.S. Maucec, B. Boskovic, Single objective real-parameter optimization: algorithm jSO, in 2017 I.E. Congress on Evolutionary Computation (CEC) (2017), pp. 1311–1318
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Mani, A., Mani, N., Bhattacharyya, S. (2020). Towards a Framework for Performance Testing of Metaheuristics. In: Bhattacharyya, S., Mitra, S., Dutta, P. (eds) Intelligence Enabled Research. Advances in Intelligent Systems and Computing, vol 1109. Springer, Singapore. https://doi.org/10.1007/978-981-15-2021-1_3
Download citation
DOI: https://doi.org/10.1007/978-981-15-2021-1_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2020-4
Online ISBN: 978-981-15-2021-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)