Skip to main content
SpringerLink
Log in

Dynamic multitask optimization with improved knowledge transfer mechanism

  • Published:
Applied Intelligence Aims and scope Submit manuscript

  • 1 Altmetric

Abstract

Multitasking optimization (MTO) is promising to become the next-generation mainstream optimization paradigm for optimizing multiple tasks simultaneously with high efficiency and accuracy. However, despite dynamic tasks abound in the real world, such as flow shop scheduling, vehicle routing, IoT, machine learning, research on dynamic multitask optimization (DMTO) has been rarely reported. DMTO problems are more challenging than MTO with static tasks or a single dynamic optimization. In this paper, a dynamic multitask optimization algorithm with an improved knowledge transfer mechanism (IK_DMTO) is proposed to solve the DMTO problems. Firstly, an improved knowledge transfer mechanism is designed to promote knowledge utilization by conditionally selecting the scale of knowledge transfer and reduce negative migration by selectively performing the crossover operation between tasks. Secondly, a new individual information update strategy is applied to guide the individual updates, in which the leaders of the sub-populations formed during the knowledge transfer process are utilized to adjust the direction of individuals to make the utmost of knowledge between tasks, and an external archive management strategy is introduced to achieve a better distribution of non-dominated solutions. Finally, nine dynamic multi-objective multitask optimization (DMOMTO) problems are constructed with the dynamic multi-objective benchmark functions to verify the effectiveness of IK_DMTO. The experimental results show that IK_DMTO can perform well on convergence compared to the comparison algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Gupta A, Ong YS, Feng L (2016) Multifactorial evolution: toward evolutionary multitasking. IEEE Trans Evol Comput 20(3):343–357

    Article  Google Scholar 

  2. Zheng X, Qin AK, Gong M, Zhou D (2020) Self-Regulated evolutionary multitask optimization. IEEE Trans Evol Comput 24(1):16–28

    Article  Google Scholar 

  3. Binh HTT , Tuan NQ, Long DCT (2019) A multi-objective multi-factorial evolutionary algorithm with reference-point-based approach. In: 2019 IEEE Congress on Evolutionary Computation (CEC), pages 2824–2831, Wellington, New Zealand, IEEE

  4. Song XF, Zhang Y, Guo YN, Sun XY, Wang YL (2020) Variable-Size cooperative coevolutionary particle swarm optimization for feature selection on High-Dimensional data. IEEE Trans Evol Comput 24(5):882–895

    Article  Google Scholar 

  5. Han F, Zheng M, Ling Q (2021) An improved multiobjective particle swarm optimization algorithm based on tripartite competition mechanism. Applied Intelligence August

  6. Xue Y, Xue B, Zhang M (2019) Self-Adaptive particle swarm optimization for large-Scale feature selection in classification. ACM Trans Knowl Discov Data 13(5):1–27

    Article  Google Scholar 

  7. Tirkolaee EB, Goli A, Faridnia A, Soltani M, Weber GW (2020) Multi-objective optimization for the reliable pollution-routing problem with cross-dock selection using Pareto-based algorithms. J Clean Prod 276:122927

    Article  Google Scholar 

  8. Tirkolaee EB, Goli A, Weber GW (2020) Fuzzy mathematical programming and self-adaptive artificial fish swarm algorithm for just-in-time energy-aware flow shop scheduling problem with outsourcing option. IEEE Trans Fuzzy Syst 28(11):2772–2783

    Article  Google Scholar 

  9. Liang Z, Dong H, Liu C, Liang W, Zhu Z (2020) Evolutionary Multitasking for Multiobjective Optimization With Subspace Alignment and Adaptive Differential Evolution. IEEE Transactions on Cybernetics pp 1–14

  10. Song H, Qin AK, Tsai PW, Liang JJ (2019) Multitasking Multi-Swarm Optimization. In: 2019 IEEE Congress on Evolutionary Computation (CEC), pp 1937–1944, Wellington, New Zealand. IEEE

  11. Mavrovouniotis M, Li C, Yang S (2017) A survey of swarm intelligence for dynamic optimization: algorithms and applications. Swarm Evol Comput 33:1–17

    Article  Google Scholar 

  12. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95 - International Conference on Neural Networks, volume 4, pages 1942–1948, Perth, WA, Australia. IEEE

  13. Jin Y, Branke J (2005) Evolutionary Optimization in Uncertain Environments—A, Survey. IEEE Trans Evol Comput 9(3):303–317

    Article  Google Scholar 

  14. Feng L, Zhou W, Zhou L, Jiang S W, Zhong J H, Da B S, Zhu Z X, Wang Y (2017) An empirical study of multifactorial PSO and multifactorial DE. In: 2017 IEEE Congress on Evolutionary Computation (CEC), pages 921–928, Donostia, San Sebastián, Spain. IEEE

  15. Gupta A, Ong YS, Feng L, Tan KC (2017) Multiobjective multifactorial optimization in evolutionary multitasking. IEEE Trans Cybern 47(7):1652–1665

    Article  Google Scholar 

  16. Chen Y, Zhong J, Tan M (2018) A Fast memetic multi-objective differential evolution for multi-tasking optimization. In: 2018 IEEE Congress on Evolutionary Computation (CEC), pp 1–8, Rio de Janeiro. IEEE

  17. Lin Jiabin, Liu Hai-Lin, Tan KC, Gu F (2021) An effective knowledge transfer approach for multiobjective multitasking optimization. IEEE Trans Cybern 51(6):3238–3248

    Article  Google Scholar 

  18. Yao S, Dong Z, Wang X, Ren L (2020) A Multiobjective multifactorial optimization algorithm based on decomposition and dynamic resource allocation strategy. Inf Sci 511:18–35

    Article  MathSciNet  MATH  Google Scholar 

  19. Osaba E, Martinez AD, Lobo JL, Del Ser J, Herrera F (2020) Multifactorial cellular genetic algorithm (mfcga): algorithmic design, performance comparison and genetic transferability analysis. In: 2020 IEEE Congress on Evolutionary Computation (CEC), pp 1–8, Glasgow, United Kingdom. IEEE

  20. Osaba E, Del Ser J, Martinez AD, Lobo JL, Herrera F (2021) AT-MFCGA,: An Adaptive Transfer-guided Multifactorial Cellular Genetic Algorithm for Evolutionary Multitasking. Inform Sci 570:577–598

    Article  MathSciNet  Google Scholar 

  21. Xie T, Gong M, Tang Z, Lei Y, Liu J, Wang Z (2016) Enhancing evolutionary multifactorial optimization based on particle swarm optimization. In: 2016 IEEE Congress on Evolutionary Computation (CEC), pp 1658–1665, Vancouver, BC, Canada. IEEE

  22. Cheng MY, Gupta A, Ong YS, Ni ZW (2017) Coevolutionary multitasking for concurrent global optimization: with case studies in complex engineering design. Eng Appl Artif Intell 64:13–24

    Article  Google Scholar 

  23. Xiao H, Yokoya G, Hatanaka T (2019) Multifactorial PSO-FA Hybrid Algorithm for Multiple Car Design Benchmark. In: 2019 IEEE international conference on systems, Man and Cybernetics (SMC), pp 1926–1931, Bari, Italy. IEEE

  24. Tang Z, Gong M (2019) Adaptive multifactorial particle swarm optimisation. CAAI Trans Intell Technol 4(1):37–46

    Article  Google Scholar 

  25. Zhang B, Qin AK, Sellis T (2018) Evolutionary feature subspaces generation for ensemble classification. In: Proceedings of the genetic and evolutionary computation conference, pp 577–584, Kyoto Japan. ACM

  26. Azzouz R, Bechikh S, Said LB (2017) Dynamic Multi-objective Optimization Using Evolutionary algorithms: A Survey Recent Advances in Evolutionary Multi-objective Optimization

  27. Raquel C, Yao X (2013) Dynamic Multi-objective Optimization: A Survey of the State-of-the-Art. In: Shengxiang Yang and Xin Yao, editors, Evolutionary Computation for Dynamic Optimization Problems, vol 490, pp 85–106. Springer Berlin Heidelberg, Berlin, Heidelberg

  28. Farina M, Deb K, Amato P (2004) Dynamic multiobjective optimization problems: test cases, approximations, and applications. IEEE Trans Evol Comput 8(5):425–442

    Article  MATH  Google Scholar 

  29. Azzouz R, Bechikh S, Said LB (2015) Multi-objective Optimization with Dynamic Constraints and objectives: New Challenges for Evolutionary Algorithms. In: Proceedings of the 2015 annual conference on genetic and evolutionary computation pp 615–622, Madrid Spain. ACM

  30. Hatzakis I, Wallace D (2006) Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach. In: Proceedings of the 8th annual conference on Genetic and evolutionary computation - GECCO ’06, pp 1201, Seattle, Washington, USA. ACM Press

  31. Koo WT, Goh CK, Tan KC (2010) A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment. Memetic Computing 2(2):87–110

    Article  Google Scholar 

  32. Goh CK, Tan KC (2009) A competitive-Cooperative coevolutionary paradigm for dynamic multiobjective optimization. IEEE Trans Evol Comput 13(1):103–127

    Article  Google Scholar 

  33. Cámara M, Ortega J, Toro FD (2007) Parallel processing for multi-objective optimization in dynamic environments. In: IEEE international parallel and distributed processing symposium

  34. Deb K, Rao UB, Karthik S (2007) Dynamic multi-objective optimization and decision-making using modified nsga-ii: A case study on hydro-thermal power scheduling. In: Proceedings of the 4th international conference on Evolutionary multi-criterion optimization

  35. Lechuga S (2009) Multi-objective Optimization Using Sharing in Swarm Optimization Algorithms. PhD thesis, University of Birmingham, Birmingham, UK

  36. Greeff M, Engelbrecht AP (2008) Solving dynamic multi-objective problems with vector evaluated particle swarm optimisation. In: Evolutionary Computation

  37. Fang SS, Chai ZY, Li YL (2021) Dynamic multi-objective evolutionary algorithm for IoT services. Appl Intell 51(3):1177–1200

    Article  Google Scholar 

  38. Liu R, Li J, Fan J, Jiao L (2018) A dynamic multiple populations particle swarm optimization algorithm based on decomposition and prediction. Appl Soft Comput 73:434–459

    Article  Google Scholar 

  39. Helbig M, Engelbrecht AP (2013) Dynamic Multi-Objective Optimization Using PSO. In: Enrique Alba, Amir Nakib, and Patrick Siarry, editors, Metaheuristics for Dynamic Optimization, vol 433, pp 147–188. Springer Berlin Heidelberg, Berlin, Heidelberg

  40. Xu B, Zhang Y, Gong D, Guo Y, Rong M (2018) Environment sensitivity-based cooperative co-evolutionary algorithms for dynamic multi-objective optimization. IEEE/ACM Trans Comput Biol Bioinform 15(6):1877–1890

    Article  Google Scholar 

  41. Goh CK, Tan KC (2009) A competitive-cooperative coevolutionary paradigm for dynamic multiobjective optimization. IEEE Trans Evol Comput 13(1):103–127

    Article  Google Scholar 

  42. Jiang S, Yang S, Yao X, Tan KC, Kaiser M, Krasnogor N (2018) Benchmark functions for the cec’2018 competition on dynamic multiobjective optimization. IEEE Congress on Evolutionary Computation

  43. Zhou A, Jin Y, Zhang Q (2013) A population prediction strategy for evolutionary dynamic multiobjective optimization. IEEE Trans Cybern 44(1):40–53

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Science Foundation of China under Grants 61890930-5, 61903010, 62021003 and 62125301, National Key Research and Development Project under Grant 2018YFC1900800-5, Beijing Natural Science Foundation under Grant KZ202110005009, and Beijing Outstanding Young Scientist Program under Grant BJJWZYJH 01201910005020 and CAAI-Huawei MindSpore Open Fund under Grant CAAIXSJLJJ-2021-017A.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Kun Ren, Fu-Xia Xiao & Hong-Gui Han

  2. Ministry of Education, Engineering Research Center of Digital Community, Beijing, 100124, China

    Kun Ren, Fu-Xia Xiao & Hong-Gui Han

  3. Artificial Intelligence Institute and Beijing Laboratory for Intelligent environmental protection, Beijing University of Technology, Beijing, 100124, China

    Hong-Gui Han

Authors
  1. Kun Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fu-Xia Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hong-Gui Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kun Ren.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ren, K., Xiao, FX. & Han, HG. Dynamic multitask optimization with improved knowledge transfer mechanism. Appl Intell 53, 1666–1682 (2023). https://doi.org/10.1007/s10489-022-03282-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03282-0

Keywords

Search

Navigation