Abstract
Optimal experimental design is a crucial aspect of statistical planning in various scientific fields. Traditional gradient-based optimization algorithms are challenged when dealing with complex experimental conditions and large numbers of factors and parameters. Heuristic algorithms have been used as an alternative; however, they may suffer from premature convergence and cannot guarantee optimal solutions. This study aims to develop a hybrid algorithm that combines the strengths of gradient-based and heuristic optimization algorithms to improve solution quality and alleviate premature convergence issues in experimental design optimization. The proposed algorithm integrates the Multiplicative Algorithm (MA) with the Queueing Search Algorithm (QSA) to address complex optimization problems. The algorithm's performance is evaluated using numerical examples from generalized linear models (GLM), specifically logistic and Poisson models, and compared with state-of-the-art algorithms such as DE, SaDE, GA, and PSO. The numerical results demonstrate the superiority of the proposed algorithm in terms of convergence speed and solution quality. The proposed algorithm consistently outperforms other algorithms, achieving higher objective function values with fewer iterations. The integration of MA with QSA provides a more effective and robust optimization algorithm for experimental design problems. The proposed algorithm exhibits improved solution quality and competitive convergence speed while alleviating premature convergence issues, making it a promising approach for complex optimization problems in experimental design.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Welch, W.J.: Algorithmic complexity: three NP-hard problems in computational statistics. J. Stat. Comput. Simul. 15(1), 17–25 (1982)
Fedorov, V.: Theory of optimal experiments. Translated from the Russian and edited by WJ Studden and EM Klimko. Probabil. Math. Stat. 12 (1972)
Wynn, H.P.: The sequential generation of D-optimum experimental designs. Ann. Math. Stat. 41(5), 1655–1664 (1970)
Silvey, S., Titterington, D., Torsney, B.: An algorithm for optimal designs on a design space. Commun. Statist.-Theory Methods 7(14), 1379–1389 (1978)
Yu, Y.: D-optimal designs via a cocktail algorithm. Stat. Comput. 21, 475–481 (2011)
Harman, R., Filová, L., Richtárik, P.: A randomized exchange algorithm for computing optimal approximate designs of experiments. J. Am. Stat. Assoc. 115(529), 348–361 (2020)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of ICNN'95-International Conference on Neural Networks, pp. 1942–1948. IEEE (1995)
Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341 (1997)
Qiu, X., Xu, J., Tan, K.C.: A novel differential evolution (DE) algorithm for multi-objective optimization. In: 2014 IEEE Congress on Evolutionary Computation (CEC), pp. 2391–2396. IEEE (2014)
Tong, L., Wong, W.K., Kwong, C.K.: Differential evolution-based optimal Gabor filter model for fabric inspection. Neurocomputing 173, 1386–1401 (2016)
Zhang, J., Xiao, M., Gao, L., Pan, Q.: Queuing search algorithm: A novel metaheuristic algorithm for solving engineering optimization problems. Appl. Math. Model. 63, 464–490 (2018)
Nguyen, B.M., Hoang, B., Nguyen, T., Nguyen, G.: nQSV-Net: a novel queuing search variant for global space search and workload modeling. J. Ambient. Intell. Humaniz. Comput. 12(1), 27–46 (2021). https://doi.org/10.1007/s12652-020-02849-4
Abdelbasit, K.M., Plackett, R.: Experimental design for binary data. J. Am. Stat. Assoc. 78(381), 90–98 (1983)
Chernoff, H.: Locally optimal designs for estimating parameters. The is used to model binary. Ann. Math. Statist. 586–602 (1953)
Li, G., Majumdar, D.: D-optimal designs for logistic models with three and four parameters. J. Statist. Plan. Inferen. 138(7), 1950–1959 (2008)
Kiefer, J., Wolfowitz, J.: The equivalence of two extremum problems. Can. J. Math. 12, 363–366 (1960)
Yu, Y.: Monotonic convergence of a general algorithm for computing optimal designs (2010)
Qin, A.K., Suganthan, P.N.: Self-adaptive differential evolution algorithm for numerical optimization. In: 2005 IEEE Congress on Evolutionary Computation, pp. 1785–1791. IEEE (2005)
Holland, J.H.: Genetic algorithms. Sci. Am. 267(1), 66–73 (1992)
Acknowledgment
The research work is supported by National Natural Science Foundation of China under Grant No.11901325.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, Y., Zhai, Y., Xia, Z., Wang, X. (2023). A Hybrid Queueing Search and Gradient-Based Algorithm for Optimal Experimental Design. In: Huang, DS., Premaratne, P., Jin, B., Qu, B., Jo, KH., Hussain, A. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2023. Lecture Notes in Computer Science, vol 14087. Springer, Singapore. https://doi.org/10.1007/978-981-99-4742-3_62
Download citation
DOI: https://doi.org/10.1007/978-981-99-4742-3_62
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-4741-6
Online ISBN: 978-981-99-4742-3
eBook Packages: Computer ScienceComputer Science (R0)