Abstract
Chemical reaction optimization is a challenging task for the industry. Its purpose is to experimentally find reaction parameters (e.g. temperature, concentration, pressure) that maximize or minimize a set of objectives (e.g. yield or selectivity of the chemical reaction). These experiments are often expensive and long (up to several days), making the use of modern optimization methods more and more attractive for chemistry scientists.
Recently, Bayesian optimization has been shown to outperform human decision-making for the optimization of chemical reactions [16]. It is well-suited for chemical reaction optimization problems, for which the evaluation is expensive and noisy.
In this paper we address the problem of chemical reaction optimization with continuous and categorical variables.
We propose a Bayesian optimization method that uses a covariance function specifically designed for categorical and continuous variables and initially proposed by Ru et al. in the COCABO method [14].
We also experimentally compare different methods to optimize the acquisition function. We measure their performances in the optimization of multiple chemical reaction (or formulation) simulators.
We find that a brute-force approach for the optimization of the acquisition function offers the best results but is too slow when there are many categorical variables or categories. However we show that an ant colony optimization technique for the optimization of the acquisition function is a well-suited alternative when the brute-force approach cannot be (reasonably) used.
We show that the proposed Bayesian optimization algorithm finds optimal reaction parameters in fewer experiments than state of the art algorithms on our simulators.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Carlson, R., Carlson, J.E.: Design and Optimization in Organic Synthesis. Elsevier, Amsterdam (2005)
Christensen, M., et al.: Data-science driven autonomous process optimization. Commun. Chem. 4(1), 1–12 (2021)
Felton, K., Rittig, J., Lapkin, A.: Summit: benchmarking machine learning methods for reaction optimisation. Chem. Methods 1(2), 116–122 (2020)
Garrido-Merchán, E.C., Hernández-Lobato, D.: Dealing with categorical and integer-valued variables in Bayesian Optimization with Gaussian processes. Neurocomputing 380, 20–35 (2020)
Häse, F., Aldeghi, M., Hickman, R.J., Roch, L.M., Aspuru-Guzik, A.: GRYFFIN: an algorithm for Bayesian optimization of categorical variables informed by expert knowledge. Appl. Phys. Rev. 8(3), 031406 (2021)
Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Coello, C.A.C. (ed.) LION 2011. LNCS, vol. 6683, pp. 507–523. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25566-3_40
Liao, T., Socha, K., de Oca, M.A.M., Stützle, T., Dorigo, M.: Ant colony optimization for mixed-variable optimization problems. IEEE Trans. Evol. Comput. 18(4), 503–518 (2013)
Lindauer, M., et al.: SMAC3: a versatile Bayesian optimization package for hyperparameter optimization. arXiv: 2109.09831 (2021)
Monden, T.: Polycarbonate resin composition (2019). EP2810989B1
Moore, K.W., Pechen, A., Feng, X.J., Dominy, J., Beltrani, V.J., Rabitz, H.: Why is chemical synthesis and property optimization easier than expected? Phys. Chem. Chem. Phys. 13(21), 10048–10070 (2011)
Morgan, S.L., Deming, S.N.: Simplex optimization of analytical chemical methods. Anal. Chem. 46(9), 1170–1181 (1974)
Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11, 3011–3015 (2010)
Reizman, B.J., Wang, Y.M., Buchwald, S.L., Jensen, K.F.: Suzuki-Miyaura cross-coupling optimization enabled by automated feedback. React. Chem. Eng. 1(6), 658–666 (2016)
Ru, B., Alvi, A., Nguyen, V., Osborne, M.A., Roberts, S.: Bayesian optimisation over multiple continuous and categorical inputs. In: International Conference on Machine Learning, pp. 8276–8285. PMLR (2020)
Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., De Freitas, N.: Taking the human out of the loop: a review of Bayesian optimization. Proc. IEEE 104(1), 148–175 (2015)
Shields, B.J., et al.: Bayesian reaction optimization as a tool for chemical synthesis. Nature 590(7844), 89–96 (2021)
Tibbetts, K.M., Feng, X.J., Rabitz, H.: Exploring experimental fitness landscapes for chemical synthesis and property optimization. Phys. Chem. Chem. Phys. 19(6), 4266–4287 (2017)
Weissman, S.A., Anderson, N.G.: Design of experiments (DoE) and process optimization. A review of recent publications. Org. Process Res. Dev. 19(11), 1605–1633 (2015)
Wolpert, D.H., Macready, W.G., et al.: No free lunch theorems for search. Tech. rep., Technical Report SFI-TR-95-02-010, Santa Fe Institute (1995)
Wright, M.H., et al.: Nelder, Mead, and the other simplex method. Doc. Math. 7, 271–276 (2010)
Xiong, Q., Jutan, A.: Continuous optimization using a dynamic simplex method. Chem. Eng. Sci. 58(16), 3817–3828 (2003)
Zhan, D., Xing, H.: Expected improvement for expensive optimization: a review. J. Global Optim. 78(3), 507–544 (2020). https://doi.org/10.1007/s10898-020-00923-x
Zhou, Z., Li, X., Zare, R.N.: Optimizing chemical reactions with deep reinforcement learning. ACS Cent. Sci. 3(12), 1337–1344 (2017)
Acknowledgement
This work was supported by the R &D Booster SMAPI project 2020 of the Auvergne-Rhöne-Alpes Region.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rabut, T., Kheddouci, H., Galeandro-Diamant, T. (2022). Categorical-Continuous Bayesian Optimization Applied to Chemical Reactions. In: Dorronsoro, B., Pavone, M., Nakib, A., Talbi, EG. (eds) Optimization and Learning. OLA 2022. Communications in Computer and Information Science, vol 1684. Springer, Cham. https://doi.org/10.1007/978-3-031-22039-5_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-22039-5_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22038-8
Online ISBN: 978-3-031-22039-5
eBook Packages: Computer ScienceComputer Science (R0)