Abstract
In engineering design the use of approximation models (= surrogate models) has become standard practice for design space exploration, sensitivity analysis, visualization and optimization. Popular surrogate model types include neural networks, support vector machines, Kriging models, and splines. An engineering simulation typically involves multiple response variables that must be approximated. With many approximation methods available, the question of which method to use for which response consistently arises among engineers and domain experts. Traditionally, the different responses are modeled separately by independent models, possibly involving a comparison among model types. Instead, this paper proposes a multi-objective approach can benefit the domain expert since it enables automatic model type selection for each output on the fly without resorting to multiple runs. In effect the optimal model complexity and model type for each output is determined automatically. In addition a multi-objective approach gives information about output correlation and facilitates the generation of diverse ensembles. The merit of this approach is illustrated with a modeling problem from aerospace.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gorissen, D., De Tommasi, L., Crombecq, K., Dhaene, T.: Sequential modeling of a low noise amplifier with neural networks and active learning. Neural Computing and Applications (accepted, 2008)
Pamadi, B.N., Covell, P.F., Tartabini, P.V., Murphy, K.J.: Aerodynamic characteristics and glide-back performance of langley glide-back booster. In: Proceedings of 22nd Applied Aerodynamics Conference and Exhibit, Providence, Rhode Island (2004)
Jin, Y., Sendhoff, B.: Pareto-based multiobjective machine learning: An overview and case studies. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38(3), 397–415 (2008)
Fenicia, F., Solomatine, D.P., Savenije, H.H.G., Matgen, P.: Soft combination of local models in a multi-objective framework. Hydrology and Earth System Sciences Discussions 4(1), 91–123 (2007)
Gorissen, D., De Tommasi, L., Croon, J., Dhaene, T.: Automatic model type selection with heterogeneous evolution: An application to rf circuit block modeling. In: Proceedings of the IEEE Congress on Evolutionary Computation, WCCI 2008, Hong Kong (2008)
Fieldsend, J.E.: Multi-objective supervised learning. In: Knowles, J., Corne, D., Deb, K. (eds.) Multiobjective Problem Solving from Nature From Concepts to Applications. Natural Computing Series. LNCS. Springer, Heidelberg (2008)
Gorissen, D., Couckuyt, I., Dhaene, T.: Multiobjective global surrogate modeling. Technical Report TR-08-08, University of Antwerp, Middelheimlaan 1, 2020 Antwerp, Belgium (2008)
Li, X.R., Zhao, Z.: Evaluation of estimation algorithms part I: incomprehensive measures of performance. IEEE Transactions on Aerospace and Electronic Systems 42(4), 1340–1358 (2006)
Knowles, J.: Parego: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Transactions on Evolutionary Computation 10(1), 50–66 (2006)
Voutchkov, I., Keane, A.: Multiobjective Optimization using Surrogates. In: Parmee, I. (ed.) Proceedings of the Seventh International Conference on Adaptive Computing in Design and Manufacture 2006, Bristol, UK, pp. 167–175 (2006)
Knowles, J., Nakayama, H.: Meta-modeling in multiobjective optimization. In: Multiobjective Optimization - Interactive and Evolutionary Approaches. LNCS. Springer, Heidelberg (in press, 2008)
Keys, A.C., Rees, L.P., Greenwood, A.G.: Performance measures for selection of metamodels to be used in simulation optimization. Decision Sciences 33, 31–58 (2007)
Escalante, H.J., Gomez, M.M., Sucar, L.E.: Psms for neural networks on the ijcnn 2007 agnostic vs prior knowledge challenge. In: IJCNN, pp. 678–683 (2007)
Lophaven, S.N., Nielsen, H.B., Søndergaard, J.: Aspects of the matlab toolbox DACE. Technical report, Informatics and Mathematical Modelling, Technical University of Denmark, DTU, Richard Petersens Plads, Building 321, DK-2800 Kgs. Lyngby (2002)
Suykens, J., Gestel, T.V., Brabanter, J.D., Moor, B.D., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific Publishing Co., Pte, Ltd., Singapore (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gorissen, D., Couckuyt, I., Crombecq, K., Dhaene, T. (2009). Pareto-Based Multi-output Model Type Selection. In: Corchado, E., Wu, X., Oja, E., Herrero, Á., Baruque, B. (eds) Hybrid Artificial Intelligence Systems. HAIS 2009. Lecture Notes in Computer Science(), vol 5572. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02319-4_53
Download citation
DOI: https://doi.org/10.1007/978-3-642-02319-4_53
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02318-7
Online ISBN: 978-3-642-02319-4
eBook Packages: Computer ScienceComputer Science (R0)