Skip to main content
Log in

Multifactorial teaching-learning-based optimization with the diversity and triangle cooperation mechanism

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Multifactorial optimization (MFO) is a newly developed optimization framework that can be embedded with an evolutionary algorithm to solve multiple optimization tasks simultaneously. To further explore the generality of the MFO framework, this paper first attempts to use teaching-learning-based optimization as a base optimizer for multiple optimization tasks (MFTLBO). However, the quality of the solution obtained by MFTLBO is not satisfactory because of premature convergence. Therefore, an MFTLBO variant named multifactorial teaching-learning-based optimization with the diversity and triangle cooperation mechanism (DTMFTLBO) is proposed to reduce premature convergence. The diversity indicator is used to dynamically adjust the exploration and exploitation. The cooperative teaching strategy based on weight is designed to acquire evolution direction information, which can guide the population toward more promising solution regions. The triangle cooperation strategy is employed to promote the knowledge transfer between different tasks in the learner phase, which can overcome premature convergence. To verify the efficiency of the proposed DTMFTLBO, numerical studies have been conducted with the 9 commonly used single objective benchmark problems of MTO. Experimental results show that the average excellent rate of the DTMFTLBO for 18 tasks is 85.80%, which confirms the competitiveness of our proposed algorithm compared with eight state-of-the-art multitask optimization algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Storn R, Price K (1995) Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces. International Computer Science Institute, Berkley Tech. Rep.

    MATH  Google Scholar 

  2. Basturk B, Karaboga D (2006) An artifical bee colony (ABC) algorithm for numeric function optimization. In: Proceedings of the IEEE Swarm Intelligence Symposium, Indianapolis, Indiana, USA, pp 12–14

    Google Scholar 

  3. Kennedy J, Eberhart R (1995) Particle swarm optimization. Proc ICNN’95: Int Conf Neural Netw 4:1942–1948

    Google Scholar 

  4. Tirkolaee EB, Goli A, Weber GW (2020) Fuzzy mathematical programming and self-adaptive artificial fish swarm algorithm for just-in-time energy-aware flow shop scheduling problem with outsourcing option. IEEE Trans Fuzzy Systems 28(11):2772–2783

    Article  Google Scholar 

  5. Alinaghian M, Tirkolaee EB, Dezaki ZK, Hejazi SR, Ding W (2021) An augmented tabu search algorithm for the green inventory-routing problem with time windows. Swarm Evol Comput 60:100802

    Article  Google Scholar 

  6. Golpîra H, Tirkolaee EB (2019) Stable maintenance tasks scheduling: a bi-objective robust optimization model. Comput Ind Eng 137:106007

    Article  Google Scholar 

  7. Feng L, Huang Y, Zhou L, Zhong J, Gupta A, Tang K, Tan KC (2021) Explicit evolutionary multitasking for combinatorial optimization: a case study on capacitated vehicle routing problem. IEEE Trans Cybern 51(6):3143–3156

    Article  Google Scholar 

  8. Gupta A, Ong YS, Feng L (2016) Multifactorial evolution: toward evolutionary multitasking. IEEE Trans Evol Comput 20(3):343–357

    Article  Google Scholar 

  9. Gong M, Tang Z, Li H, Zhang J (2019) Evolutionary multitasking with dynamic resource allocating strategy. IEEE Trans Evol Comput 23(5):858–869

    Article  Google Scholar 

  10. Feng L, Zhou W, Zhou L, Jiang SW, Zhong JH, Da BS, Zhu ZX, Wang Y (2017) An empirical study of multifactorial PSO and multifactorial DE. In: 2017 IEEE Congress on Evolutionary Computation (CEC), 2017, June, Donostia, Spain, pp 921–928

    Google Scholar 

  11. Li W, Yuan J, Luo H, Lei Z, Xu Q (2020) Enhanced competitive swarm optimizer for multi-task optimization. In: International Conference on Computing and Pattern Recognition (ICCPR), 2020 October, Xiamen, China, pp 455–459

    Google Scholar 

  12. Tang Z, Gong M, Wu Y, Liu W, Xie Y (2020) Regularized evolutionary multitask optimization: learning to intertask transfer in aligned subspace. IEEE Trans Evol Comput 25(2):262–276

    Article  Google Scholar 

  13. Zheng X, Qin AK, Gong M, Zhou D (2020) Self-regulated evolutionary multitask optimization. IEEE Trans Evol Comput 24(1):16–28

    Article  Google Scholar 

  14. Yin J, Zhu A, Zhu Z, Yu Y, Ma X (2019) Multifactorial evolutionary algorithm enhanced with cross-task search direction. In: 2019 IEEE Congress on Evolutionary Computation (CEC), 2019, June, Wellington, New Zealand, pp 2244–2251

    Google Scholar 

  15. Zheng X, Lei Y, Qin AK, Zhou D, Shi J, Gong M (2019) Differential evolutionary multi-task optimization. In: 2019 IEEE Congress on Evolutionary Computation (CEC), 2019, June, Wellington, New Zealand, pp 1914–1921

    Google Scholar 

  16. Tang Z, Gong M (2019) Adaptive multifactorial particle swarm optimization. CAAI Trans Intell Technol 4(1):37–46

    Article  Google Scholar 

  17. Zhou L, Feng L, Liu K, Chen C, Deng S, Xiang T, Jiang S (2019) Towards effective mutation for knowledge transfer in multifactorial differential evolution. In: 2019 IEEE Congress on Evolutionary Computation (CEC), 2019, June, Wellington, New Zealand, pp 1541–1547

    Google Scholar 

  18. Zhou L, Feng L, Tan KC, Zhong J, Zhu Z, Liu K, Chen C (2021) Toward adaptive knowledge transfer in multifactorial evolutionary computation. IEEE Trans Cybern 51(5):2563–2576

    Article  Google Scholar 

  19. Li G, Zhang Q, Gao W (2018) Multipopulation evolution framework for multifactorial optimization. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion (CECCO), New York, NY, USA, pp 215–216

    Chapter  Google Scholar 

  20. Li G, Lin Q, Gao W (2020) Multifactorial optimization via explicit multipopulation evolutionary framework. Inform Sci 512:1555–1570

    Article  Google Scholar 

  21. Feng L, Zhou L, Zhong J, Gupta A, Ong YS, Tan KC, Qin AK (2019) Evolutionary multitasking via explicit autoencoding. IEEE Trans Cybern 49(9):3457–3470

    Article  Google Scholar 

  22. Lin J, Liu HL, Tan KC, Gu F (2020) An effective knowledge transfer approach for multiobjective multitasking optimization. IEEE Trans Cybern 51(6):3238–3248

    Article  Google Scholar 

  23. Liang Z, Dong H, Liu C, Liang W, Zhu Z (2020) Evolutionary multitasking for multiobjective optimization with subspace alignment and adaptive differential evolution. IEEE Trans Cybern:1–14

  24. Bali KK, Gupta A, Ong YS, Tan PS (2021) Cognizant multitasking in multiobjective multifactorial evolution: MO-MFEA-II. IEEE Trans Cybern 51(4):1–13

    Article  Google Scholar 

  25. Zhong J, Feng L, Cai W, Ong YS (2020) Multifactorial genetic programming for symbolic regression problems. IEEE Trans Syst Man Cybern: Syst 50(11):4492–4505

    Article  Google Scholar 

  26. Chen W, Zhu Z, He S (2020) MUMI: Multitask module identification for biological networks. IEEE Trans Evol Comput 24(4):765–776

    Article  Google Scholar 

  27. Martinez AD, Osaba E, Sery JD, Herrera F (2020) Simultaneously evolving deep reinforcement learning models using multifactorial optimization. In: Proceedings of the IEEE Conference on Evolutionary Computation, Glasgow, UK, 2020, July, pp 1–8

    Google Scholar 

  28. Rao RV, Savsani VJ, Vakharia DP (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aid Des 43:303–315

    Article  Google Scholar 

  29. Da BS, Ong YS, Feng L, Qin AK, Gupta A, Zhu ZX, Ting CK, Tang K, Yao X (2016) Evolutionary multitasking for single-objective continuous optimization: Benchmark problems, performance metrics and baseline results. Technical report. Nanyang Technological University

    Google Scholar 

  30. Poláková R, Tvrdík J, Bujok P (2019) Differential evolution with adaptive mechanism of population size according to current population diversity. Swarm Evol Comput 50:1–15

    Article  Google Scholar 

  31. Cai Y, Peng D, Fu S, Tian H (2019) Multitasking differential evolution with difference vector sharing mechanism. In: 2019 IEEE Symposium Series on Computational Intelligence (SSCI), 2019, December, Xiamen, China, pp 3039–3046

    Chapter  Google Scholar 

  32. Wang Y, Cai ZX, Zhang QF (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66

    Article  Google Scholar 

  33. Alcalá-Fdez J, Sánchez L, García S, del Jesus MJ, Ventura S, Garrell JM, Otero J, Romero C, Bacardit J, Rivas VM, Fernández JC, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3):307–318

    Article  Google Scholar 

Download references

Acknowledgments

This research is partly supported by the National Natural Science Foundation of China under Project Code (61803301, 61773314), and the Scientific Research Foundation of the National University of Defense Technology (grant no. ZK18-03-43).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Li.

Ethics declarations

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, W., Fan, Y., Wang, L. et al. Multifactorial teaching-learning-based optimization with the diversity and triangle cooperation mechanism. Appl Intell 52, 16512–16531 (2022). https://doi.org/10.1007/s10489-021-03059-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-03059-x

Keywords

Navigation