Abstract
Dynamic multi-objective problems (DMOPs) permeate all aspects of daily life and practical applications. As the variables of the search space or target space alter in pace with time, savants are also deepening the research on DMOPs, among which methods based on prediction mechanisms have been extensively developed. The historical optimal solutions can effectively predict the trend and location of the optimal solutions in the future. In this paper, a new hybrid prediction model (HPM) integrating the fuzzy linear prediction model with entropy-like kernel function and the one-step prediction model is developed to sort out DMOPs. In the method, the predicted center by the HPM prediction model is combined with the approximate manifold of PS to generate a trail population, and the linear one-step prediction model is utilized to generate another trail population. When the environment changes, the initial PS at the next moment is obtained by randomly crossing these two trail populations. To assess the proposed HPM model, it is compared with the reinitialization strategy, feedforward prediction strategy, population prediction strategy, T-S nonlinear regression strategy with multistep prediction and individual-based transfer learning under different MOEA optimizers for 22 benchmark problems. The results indicate that HPM has great advantages in solving these dynamic optimization problems.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The data that support the findings of this study are available from the corresponding author upon request.
References
Fogel LJ, Owens AJ, Walsh MJ (1966) Intelligent decision making through a simulation of evolution. Behav Sci 11(4):253–272
Goldberg D E, Smith R E. Nonstationary function optimization using genetic algorithm with dominance and diploidy Proceedings of the Second International Conference on Genetic Algorithms on Genetic algorithms and their application. 1987: 59–68
Wang Y, Li B (2009) Investigation of memory-based multi-objective optimization evolutionary algorithm in dynamic environment 2009 IEEE congress on evolutionary computation. IEEE:630–637
Sahmoud S, Topcuoglu HR A memory-based NSGA-II algorithm for dynamic multi-objective optimization problems European Conference on the Applications of Evolutionary Computation. Springer, Cham, 2016: 296–310.
Cao L, Xu L, Goodman ED (2018) A neighbor-based learning particle swarm optimizer with short-term and long-term memory for dynamic optimization problems. Inf Sci 453:463–485
Liang JJ, Qu BY, Suganthan PN et al (2012) Dynamic multi-swarm particle swarm optimization for multi-objective optimization problems 2012 IEEE congress on evolutionary computation. IEEE:1–8
Li C, Yang S Fast multi-swarm optimization for dynamic optimization problems 2008 Fourth international conference on natural computation. IEEE 2008(7):624–628
Rao RV, Saroj A (2017) A self-adaptive multi-population based Jaya algorithm for engineering optimization. Swarm Evol Comput 37:1–26
Zhou A, Jin Y, Zhang Q, et al. Prediction-based population re-initialization for evolutionary dynamic multi-objective optimization. International conference on evolutionary multi-criterion optimization. Springer, Berlin, Heidelberg, 2007: 832–846
Hatzakis I, Wallace D. Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach. Proceedings of the 8th annual conference on Genetic and evolutionary computation. 2006: 1201–1208
Zhou A, Jin Y, Zhang Q (2014) A population prediction strategy for evolutionary dynamic multiobjective optimization. IEEE Trans Cybern 44(1):40–53
Koo WT, Goh CK, Tan KC (2010) A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment. Memetic Comput 2(2):87–110
Peng Z, Zheng J, Zou Jet al Novel prediction and memory strategies for dynamic multiobjective optimization. Soft Comput, 2015, 19(9): 2633–2653
Zou J, Li Q, Yang S, Bai H, Zheng J (2017) A prediction strategy based on center points and knee points for evolutionary dynamic multi-objective optimization. Appl Soft Comput 61:806–818
Cao L, Xu L, Goodman ED et al (2019) Decomposition-based evolutionary dynamic multiobjective optimization using a difference model. Appl Soft Comput 76:473–490
Rong M, Gong D, Zhang Yet al Multidirectional prediction approach for dynamic multiobjective optimization problems. IEEE Trans Cybern, 2019, 49(9): 3362–3374
Li Q, Zou J, Yang S, Zheng J, Ruan G (2019) A predictive strategy based on special points for evolutionary dynamic multi-objective optimization. Soft Comput 23(11):3723–3739
Kong X, Ouyang H, Piao X (2013) A prediction-based adaptive grouping differential evolution algorithm for constrained numerical optimization. Soft Comput 17(12):2293–2309
Khooban MH, Vafamand N, Niknam T (2016) T–S fuzzy model predictive speed control of electrical vehicles. ISA Trans 64:231–240
Zhang Y, Zhang Z (2016) Research of fuzzy predictive control based on TS model 2016 Chinese control and decision conference (CCDC). IEEE:4839–4844
Guo Y, Yang H, Chen M, Cheng J, Gong D (2019) Ensemble prediction-based dynamic robust multi-objective optimization methods. Swarm Evol Comput 48:156–171
Rong M, Gong D, Pedrycz W, Wang L (2020) A multimodel prediction method for dynamic multiobjective evolutionary optimization. IEEE Trans Evol Comput 24(2):290–304
Wang F, Li Y, Liao F, Yan H (2020) An ensemble learning based prediction strategy for dynamic multi-objective optimization. Appl Soft Comput 96:106592
Liang Z, Zou Y, Zheng S, Yang S, Zhu Z (2021) A feedback-based prediction strategy for dynamic multi-objective evolutionary optimization. Expert Syst Appl 172:114594
Li X, Yang J, Sun H, Hu Z, Cao A (2021) A dual prediction strategy with inverse model for evolutionary dynamic multiobjective optimization. ISA Trans 117:196–209
Zou F, Chen D, Xu Q, Lu R (2020) A new prediction strategy combining TS fuzzy nonlinear regression prediction and multi-step prediction for dynamic multi-objective optimization. Swarm Evol Comput 59:100749
Jiang M, Wang Z, Guo S, Gao X, Tan KC (2021) Individual-based transfer learning for dynamic multiobjective optimization. IEEE Trans Cybern 51(10):4968–4981
Muruganantham A, Tan KC, Vadakkepat P (2016) Evolutionary dynamic multiobjective optimization via Kalman filter prediction. IEEE Trans Cybern 46(12):2862–2873
Ruan G, Yu G, Zheng J, Zou J, Yang S (2017) The effect of diversity maintenance on prediction in dynamic multi-objective optimization. Appl Soft Comput 58:631–647
Jiang S, Yang S (2017) A steady-state and generational evolutionary algorithm for dynamic multiobjective optimization. IEEE Trans Evol Comput 21(1):65–82
Zheng J, Zhou Y, Zou J, Yang S, Ou J, Hu Y (2021) A prediction strategy based on decision variable analysis for dynamic multi-objective optimization. Swarm Evol Comput 60:100786
Chen X, Zhang D, Zeng X (2015) A stable matching-based selection and memory enhanced MOEA/D for evolutionary dynamic multiobjective optimization. 2015 IEEE 27th Int Conf Tools Artif Intell (ICTAI), IEEE:478–485
Gee SB, Tan KC, Alippi C (2017) Solving multiobjective optimization problems in unknown dynamic environments: an inverse modeling approach. IEEE Trans Cybernet 47(12):4223–4234
Bregman LM (1967) The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Comput Math Math Phys 7(3):200–217
Goldberger J, Gordon S, Greenspan H (2003) An efficient image similarity measure based on approximations of KL-divergence between two Gaussian mixtures. ICCV. 3:487–493
Menéndez ML, Pardo JA, Pardo L, Pardo MC (1997) The jensen-shannon divergence. J Franklin Inst 334(2):307–318
Fuglede B, Topsoe F (2004) Jensen-Shannon divergence and Hilbert space embedding International Symposium on Information Theory, 2004. ISIT 2004. Proceedings. IEEE:31
Wu C, Cao Z (2021) Entropy-like divergence based kernel fuzzy clustering for robust image segmentation. Expert Syst Appl 169:114327
Lin J (1991) Divergence measures based on the Shannon entropy. IEEE Trans Inf Theory 37(1):145–151
Kalam R, Thomas C, Rahiman MA (2016) Gaussian Kernel Based Fuzzy CMeans Clustering Algorithm For Image Segmentation. Comput. Sci. Inf. Technol:47–56
Gustafson DE, Kessel WC (1978) Fuzzy clustering with a fuzzy covariance matrix 1978 IEEE conference on decision and control including the 17th symposium on adaptive processes. IEEE:761–766
Hai DT, Le Vinh T (2017) Novel fuzzy clustering scheme for 3D wireless sensor networks. Appl Soft Comput 54:141–149
Binesh N, Rezghi M (2018) Fuzzy clustering in community detection based on nonnegative matrix factorization with two novel evaluation criteria. Appl Soft Comput 69:689–703
Liu PX, Meng MQH (2004) Online data-driven fuzzy clustering with applications to real-time robotic tracking. IEEE Trans Fuzzy Syst 12(4):516–523
Abu-Zitar R (2008) The Ising genetic algorithm with Gibbs distribution sampling: application to FIR filter design. Appl Soft Comput 8(2):1085–1092
Zhang Y, Zhang Z (2016) Research of fuzzy predictive control based on TS model. 2016 Chinese Control and Decision Conference (CCDC). IEEE:4839–4844
Li C, Zhou J, Chang L, Huang Z, Zhang Y (2017) T–S fuzzy model identification based on a novel hyperplane-shaped membership function. IEEE Trans Fuzzy Syst 25(5):1364–1370
Binggeli B, Sandage A, Tarenghi M (1984) Studies of the Virgo cluster. I-photometry of 109 galaxies near the cluster center to serve as standards. Astron J 89:64–82
Farina M, Deb K, Amato P (2004) Dynamic multiobjective optimization problems: test cases, approximations, and applications. IEEE Trans Evol Comput 8(5):425–442
Goh CK, Tan KC (2009) A competitive-cooperative coevolutionary paradigm for dynamic multiobjective optimization. IEEE Trans Evol Comput 13(1):103–127
Jiang S, Yang S, Yao X et al (2018) Benchmark problems for CEC2018 competition on dynamic multiobjective optimization. Proc CEC Competition:1–18
Wu Y, Jin Y, Liu X (2015) A directed search strategy for evolutionary dynamic multiobjective optimization. Soft Comput 19(11):3221–3235
Muruganantham A, Zhao Y, Gee SB, Qiu X, Tan KC (2013) Dynamic multiobjective optimization using evolutionary algorithm with Kalman filter. Procedia Comp Sci 24:66–75
Zhang X, Tian Y, Cheng R et al (2015) An efficient approach to nondominated sorting for evolutionary multiobjective optimization. IEEE Trans Evol Comput 19(2):201–213
Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731
Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 19(6):761–776
Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(5):773–791
Zhang Q, Zhou A, Jin Y (2008) RM-MEDA: a regularity model-based multiobjective estimation of distribution algorithm. IEEE Trans Evol Comput 12(1):41–63
Wilcoxon F. Individual comparisons by ranking methods. Breakthroughs in statistics. Springer, New York, NY, 1992: 196–202
Acknowledgements
This work is partially supported by the National Natural Science Foundation of China (No. 61976101), the University Natural Science Research Project of Anhui Province (No. KJ2019A0593) and the technical leaders and reserve candidates in Anhui Province under Grant No.2021H264.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 186 kb)
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cao, S., Zou, F., Chen, D. et al. A new hybrid prediction model with entropy-like kernel function for dynamic multi-objective optimization. Appl Intell 53, 10500–10519 (2023). https://doi.org/10.1007/s10489-022-03934-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-022-03934-1