Heuristic Initialization and Knowledge-based Mutation for Large-Scale Multi-Objective 0-1 Knapsack Problems
Pages 178 - 186
Abstract
Recently, there has been a growing interest in large-scale multiobjective optimization problems within the evolutionary multiobjective optimization (EMO) community. These problems involve hundreds or thousands of decision variables and multiple conflicting objectives, which pose significant challenges for conventional EMO algorithms (EMOAs). It is generally believed that EMOAs have difficulty in efficiently finding good non-dominated solutions as the number of decision variables increases. To address this issue, in this paper, we propose a novel method that incorporates heuristic initialization and knowledge-based mutation into EMOAs for solving large-scale multi-objective 0-1 knapsack problems. Various large-scale multi-objective 0-1 knapsack problems with an arbitrary number of constraints are generated as test problems to evaluate the effectiveness of the proposed method. Experimental results show that the proposed novel initialization and mutation method significantly improves the performance of the original EMOAs in terms of both the convergence speed in early generations and the quality of the final population.
Supplemental Material
PDF File
Supplementary Material
- Download
- 4.39 MB
References
[1]
AKM Khaled Ahsan Talukder, Kalyanmoy Deb, and Shahryar Rahnamayan. 2017. Injection of extreme points in evolutionary multiobjective optimization algorithms. In Evolutionary Multi-Criterion Optimization: 9th International Conference, EMO 2017, Münster, Germany, March 19-22, 2017, Proceedings 9. Springer, 590--605.
[2]
MOSEK ApS. 2019. The MOSEK optimization toolbox for MATLAB manual. Version 9.0. http://docs.mosek.com/9.0/toolbox/index.html
[3]
Nicola Beume, Boris Naujoks, and Michael Emmerich. 2007. SMS-EMOA: Multiobjective selection based on dominated hypervolume. European Journal of Operational Research 181, 3 (2007), 1653--1669.
[4]
Bin Cao, Jianwei Zhao, Zhihan Lv, and Xin Liu. 2017. A distributed parallel cooperative coevolutionary multiobjective evolutionary algorithm for large-scale optimization. IEEE Transactions on Industrial Informatics 13, 4 (2017), 2030--2038.
[5]
Ran Cheng, Yaochu Jin, Markus Olhofer, et al. 2016. Test problems for large-scale multiobjective and many-objective optimization. IEEE Transactions on Cybernetics 47, 12 (2016), 4108--4121.
[6]
Ian M Cooper, Matthew P John, Rhydian Lewis, Christine L Mumford, and Andrew Olden. 2014. Optimising large scale public transport network design problems using mixed-mode parallel multi-objective evolutionary algorithms. In 2014 IEEE Congress on Evolutionary Computation (CEC). IEEE, 2841--2848.
[7]
Suresh Dara, Swetha Dhamercherla, Surender Singh Jadav, C.H. Babu, and Mohamed Jawed Ahsan. 2022. Machine learning in drug discovery: a review. Artificial Intelligence Review 55, 3 (2022), 1947--1999.
[8]
Indraneel Das and John E Dennis. 1998. Normal-boundary intersection: A new method for generating the Pareto surface in nonlinear multicriteria optimization problems. SIAM Journal on Optimization 8, 3 (1998), 631--657.
[9]
Kalyanmoy Deb and Himanshu Jain. 2013. An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Transactions on Evolutionary Computation 18, 4 (2013), 577--601.
[10]
Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2 (2002), 182--197.
[11]
Juan J Durillo, Antonio J Nebro, Carlos A Coello Coello, José García-Nieto, Francisco Luna, and Enrique Alba. 2010. A study of multiobjective metaheuristics when solving parameter scalable problems. IEEE Transactions on Evolutionary Computation 14, 4 (2010), 618--635.
[12]
Juan J Durillo, Antonio J Nebro, Carlos A Coello Coello, Francisco Luna, and Enrique Alba. 2008. A comparative study of the effect of parameter scalability in multi-objective metaheuristics. In 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). IEEE, 1893--1900.
[13]
Cheng Gong, Yang Nan, Lie Meng Pang, Qingfu Zhang, and Hisao Ishibuchi. 2023. Effects of Including Optimal Solutions into Initial Population on Evolutionary Multiobjective Optimization. In Proceedings of the Genetic and Evolutionary Computation Conference. 661--669.
[14]
Cheng He, Ran Cheng, and Danial Yazdani. 2020. Adaptive offspring generation for evolutionary large-scale multiobjective optimization. IEEE Transactions on Systems, Man, and Cybernetics: Systems 52, 2 (2020), 786--798.
[15]
Haokai Hong, Kai Ye, Min Jiang, Donglin Cao, and Kay Chen Tan. 2022. Solving large-scale multiobjective optimization via the probabilistic prediction model. Memetic Computing 14, 2 (2022), 165--177.
[16]
Wen-Jing Hong, Peng Yang, and Ke Tang. 2021. Evolutionary computation for large-scale multi-objective optimization: A decade of progresses. International Journal of Automation and Computing 18, 2 (2021), 155--169.
[17]
Minghan Li and Jingxuan Wei. 2018. A cooperative co-evolutionary algorithm for large-scale multi-objective optimization problems. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. 1716--1721.
[18]
Ruochen Liu, Rui Ren, Jin Liu, and Jing Liu. 2020. A clustering and dimensionality reduction based evolutionary algorithm for large-scale multi-objective problems. Applied Soft Computing 89 (2020), 106120.
[19]
Johan Lofberg. 2004. YALMIP: A toolbox for modeling and optimization in MATLAB. In 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No. 04CH37508). IEEE, 284--289.
[20]
Zhichao Lu, Ian Whalen, Vishnu Boddeti, Yashesh Dhebar, Kalyanmoy Deb, Erik Goodman, and Wolfgang Banzhaf. 2019. Nsga-net: neural architecture search using multi-objective genetic algorithm. In Proceedings of the Genetic and Evolutionary Computation Conference. 419--427.
[21]
Heikki Maaranen, Kaisa Miettinen, and Marko M. Mäkelä. 2004. Quasi-random initial population for genetic algorithms. Computers & Mathematics with Applications 47, 12 (2004), 1885--1895.
[22]
Sedigheh Mahdavi, Shahryar Rahnamayan, and Kalyanmoy Deb. 2016. Center-based initialization of cooperative co-evolutionary algorithm for large-scale optimization. In 2016 IEEE Congress on Evolutionary Computation (CEC). IEEE, 3557--3565.
[23]
Lie Meng Pang, Hisao Ishibuchi, and Ke Shang. 2022. Counterintuitive Experimental Results in Evolutionary Large-Scale Multiobjective Optimization. IEEE Transactions on Evolutionary Computation 26, 6 (2022), 1609--1616.
[24]
Hemant Kumar Singh, Kalyan Shankar Bhattacharjee, and Tapabrata Ray. 2018. Distance-based subset selection for benchmarking in evolutionary multi/many-objective optimization. IEEE Transactions on Evolutionary Computation 23, 5 (2018), 904--912.
[25]
Ye Tian, Chang Lu, Xingyi Zhang, Fan Cheng, and Yaochu Jin. 2020. A pattern mining-based evolutionary algorithm for large-scale sparse multiobjective optimization problems. IEEE Transactions on Cybernetics 52, 7 (2020), 6784--6797.
[26]
Ye Tian, Langchun Si, Xingyi Zhang, Ran Cheng, Cheng He, Kay Chen Tan, and Yaochu Jin. 2021. Evolutionary large-scale multi-objective optimization: A survey. ACM Computing Surveys (CSUR) 54, 8 (2021), 1--34.
[27]
Ye Tian, Xingyi Zhang, Chao Wang, and Yaochu Jin. 2019. An evolutionary algorithm for large-scale sparse multiobjective optimization problems. IEEE Transactions on Evolutionary Computation 24, 2 (2019), 380--393.
[28]
Ye Tian, Xiutao Zheng, Xingyi Zhang, and Yaochu Jin. 2019. Efficient large-scale multiobjective optimization based on a competitive swarm optimizer. IEEE Transactions on Cybernetics 50, 8 (2019), 3696--3708.
[29]
Qingfu Zhang and Hui Li. 2007. MOEA/D: A multiobjective evolutionary algorithm based on decomposition. IEEE Transactions on Evolutionary Computation 11, 6 (2007), 712--731.
[30]
Eckart Zitzler and Lothar Thiele. 1999. Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 3, 4 (1999), 257--271.
Index Terms
- Heuristic Initialization and Knowledge-based Mutation for Large-Scale Multi-Objective 0-1 Knapsack Problems
Recommendations
Performance of NSGA-III on Multi-objective Combinatorial Optimization Problems Heavily Depends on Its Implementations
GECCO '24: Proceedings of the Genetic and Evolutionary Computation ConferenceNewly proposed many-objective algorithms have been almost always compared with NSGA-III for performance evaluation. Since the authors of the NSGA-III paper have not provided any source code, researchers usually use an available implementation in popular ...
Evolutionary Large-Scale Multi-Objective Optimization: A Survey
Multi-objective evolutionary algorithms (MOEAs) have shown promising performance in solving various optimization problems, but their performance may deteriorate drastically when tackling problems containing a large number of decision variables. In recent ...
Effects of Including Optimal Solutions into Initial Population on Evolutionary Multiobjective Optimization
GECCO '23: Proceedings of the Genetic and Evolutionary Computation ConferenceA long-standing question in the evolutionary multi-objective (EMO) community is how to generate a good initial population for EMO algorithms. Intuitively, as the starting point of optimization, a good initial population can have positive effects on ...
Comments
Information & Contributors
Information
Published In
July 2024
1657 pages
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- National Natural Science Foundation of China
- Guangdong Provincial Key Laboratory
- the Research Grants Council of the Hong Kong Special Administrative Region, China
Conference
GECCO '24
Sponsor:
GECCO '24: Genetic and Evolutionary Computation Conference
July 14 - 18, 2024
VIC, Melbourne, Australia
Acceptance Rates
Overall Acceptance Rate 1,669 of 4,410 submissions, 38%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 89Total Downloads
- Downloads (Last 12 months)89
- Downloads (Last 6 weeks)16
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in