Abstract
When dealing with black box optimization problem, the nature of the problem cannot be completely mastered and the position where the optimal solution appears cannot be determined. A sufficient search of all feasible regions is the necessary way to obtain the global optimal solution. As a kind of method based on search with population, evolutionary computing has attracted much attention in the field of optimization. Compared with the traditional search method, the population is expected to expand the search area, but in many instances, the solutions of the evolutionary algorithms cannot explore wide area continuously and effectively. Specifically, after several iterations, the general optimizer focuses the solutions near a small region and output one promising solution. In the limited range, population lose the advantage of searching several regions meanwhile. In this article, a new framework called optimization based on nonlinear transformation in decision space (ONTD) is proposed, in which a problem population is generated by converting a given problem. And each converted problem (subproblem) has its own interesting area with high calculation weight on the decision space. The optimizers combining differential evolution operator and ONTD are instantiated for comparison. And an adaptive ONTD strategy (AONTD) is proposed to adjust high calculation region of each converted problem. Through dealing with the different converted problems at the same time, on the test and trap problems, several optima can be retained with the optimizers based on ONTD. And on the benchmark problems, the optimizers based on ONTD also have competitive performance.
Similar content being viewed by others
References
AlRashidi M, El-Hawary M (2009) A survey of particle swarm optimization applications in electric power systems. Evolut Comput IEEE Trans 13(4):913–918. https://doi.org/10.1109/TEVC.2006.880326
Boyd S, Vandenberghe L (2009) Convex optimization. Cambridge University Press, Cambridge
Brest J, Greiner S, Boskovic B, Mernik M (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. Evolut Comput IEEE Trans 10(6):646–657
Cheng S, Qin Q, Chen J, Shi Y (2016a) Brain storm optimization algorithm: a review. Artif Intell Rev 46(4):445–458. https://doi.org/10.1007/s10462-016-9471-0
Cheng S, Zhang Q, Qin Q (2016b) Big data analytics with swarm intelligence. Ind Manage & Data Syst 116(4):646–666. https://doi.org/10.1108/IMDS-06-2015-0222
Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. Syst Man Cybern Part B Cybern IEEE Trans 26(1):29–41. https://doi.org/10.1109/3477.484436
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Micro machine and human science, 1995. MHS ’95., Proceedings of the sixth international symposium, pp 39–43. https://doi.org/10.1109/MHS.1995.494215
Gong YJ, Zhang J, Chung H, Chen WN, Zhan ZH, Li Y, Shi YH (2012) An efficient resource allocation scheme using particle swarm optimization. Evolut Comput IEEE Trans 16(6):801–816. https://doi.org/10.1109/TEVC.2012.2185052
Hansen N, Ostermeier A (1996) Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In: Evolutionary computation, 1996, proceedings of IEEE international conference, pp 312–317. https://doi.org/10.1109/ICEC.1996.542381
Holland JH (1992) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control and artificial intelligence. MIT Press, Cambridge
Hooke R, Jeeves TA (1961) “ Direct search” solution of numerical and statistical problems. J ACM 8(2):212–229. https://doi.org/10.1145/321062.321069
Hu M, Wu T, Weir J (2013) An adaptive particle swarm optimization with multiple adaptive methods. Evolut Comput IEEE Trans 17(5):705–720. https://doi.org/10.1109/TEVC.2012.2232931
Kennedy J, Eberhart R (1995) Particle swarm optimization 4:1942–1948. https://doi.org/10.1109/ICNN.1995.488968
Li JP, Wood AS (2009) An adaptive species conservation genetic algorithm for multimodal optimization. Int J Numer Methods Eng 79(13):1633–1661. https://doi.org/10.1002/nme.2621
Li JP, Balazs ME, Parks GT, Clarkson PJ (2002) A species conserving genetic algorithm for multimodal function optimization. Evol Comput 10(3):207–234. https://doi.org/10.1162/106365602760234081
Liang J, Qin A, Suganthan P, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. Evolut Comput IEEE Trans 10(3):281–295. https://doi.org/10.1109/TEVC.2005.857610
Liang J, Qu B, Suganthan P, Hernández-Díaz AG (2012) Problem definitions and evaluation criteria for the CEC 2013 special session on real-parameter optimization. Technical Report 12. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China and Nanyang Technological University, Singapore
Lu X, Tang K, Sendhoff B, Yao X (2014) A review of concurrent optimisation methods. Int J Bioinspired Comput 6(1):22–31
Nocedal J, Wright SJ (2006) Conjugate gradient methods. Springer, New York
Potter MA, Jong KAD (1994) A cooperative coevolutionary approach to function optimization. Lect Notes Comput Sci 866:249–257
Press WH, Flannery BP, Teukolsky SA, Vetterling WT (1987) Numerical recipes: the art of scientific computing, vol 2. Cambridge University Press, London
Qu B, Suganthan P, Liang J (2012) Differential evolution with neighborhood mutation for multimodal optimization. Evolut Comput IEEE Trans 16(5):601–614. https://doi.org/10.1109/TEVC.2011.2161873
Rahnamayan S, Tizhoosh H, Salama M (2008) Opposition-based differential evolution. Evolut Comput IEEE Trans 12(1):64–79. https://doi.org/10.1109/TEVC.2007.894200
Rosenbrock H (1963) Some general implicit processes for the numerical solution of differential equations. Comput J 5(4):329–330
Sarker R, Elsayed S, Ray T (2014) Differential evolution with dynamic parameters selection for optimization problems. Evolut Comput IEEE Trans 18(5):689–707. https://doi.org/10.1109/TEVC.2013.2281528
Storn R (1999) System design by constraint adaptation and differential evolution. IEEE Trans Evolut Comput 3(1):22–34. https://doi.org/10.1109/4235.752918
Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359. https://doi.org/10.1023/A:1008202821328
Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. Evolut Comput IEEE Trans 15(1):55–66. https://doi.org/10.1109/TEVC.2010.2087271
Yanga Z, Ke T, Xin Y (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999
Yang Z, Tang K, Yao X (2007) Differential evolution for high-dimensional function optimization. In: Evolutionary Computation 2007, CEC 2007. IEEE Congress, pp 3523–3530
Zhan ZH, Zhang J, Li Y, hui Shi Y (2011) Orthogonal learning particle swarm optimization. Evolut Comput IEEE Trans 15(6):832–847. https://doi.org/10.1109/TEVC.2010.2052054
Zhang J, Sanderson AC (2007) Jade: Self-adaptive differential evolution with fast and reliable convergence performance. In: 2007 IEEE congress on evolutionary computation, pp 2251–2258. https://doi.org/10.1109/CEC.2007.4424751
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant Nos. 61772399, U170126, 61773304, 61672405 and 61772400, the Program for Cheung Kong Scholars and Innovative Research Team in University Grant IRT_15R53, the Fund for Foreign Scholars in University Research and Teaching Programs (the 111 Project) Grant B07048, Joint Fund of the Equipment Research of Ministry of Education under Grant 6141A02022301, and the Major Research Plan of the National Natural Science Foundation of China Grant 91438201.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by A. Di Nola.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, Y., Peng, C., Wang, Y. et al. Optimization based on nonlinear transformation in decision space. Soft Comput 23, 3571–3590 (2019). https://doi.org/10.1007/s00500-018-3209-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-018-3209-7