Nessrine Azzouz
ABSTRACT
Several engineering problems involve simultaneously several objective functions where at least one of them is expensive to evaluate. This fact has yielded to a new class of Multi-Objective Problems (MOPs) called expensive MOPs. Several attempts have been conducted in the literature with the goal to minimize the number of expensive evaluations by using surrogate models stemming from the machine learning field. Usually, researchers substitute the expensive objective function evaluation by an estimation drawn from the used surrogate. In this paper, we propose a new way to tackle expensive MOPs. The main idea is to use Neural Networks (NNs) within the Indicator-Based Evolutionary Algorithm (IBEA) in order to estimate the contribution of each generated offspring in terms of hypervolume. After that, only fit individuals with respect to the estimations are exactly evaluated. Our proposed algorithm called NN-SS-IBEA (Neural Networks assisted Steady State IBEA) have been demonstrated to provide good performance with a low number of function evaluations when compared against the original IBEA and MOEA/D-RBF on a set of benchmark problems in addition to the airfoil design problem.
- S. Bechikh. Incorporating Decision Maker's Preference Information in Evolutionary Multi-objective Optimization. PhD thesis, High Institute of Management of Tunis, University of Tunis, Tunisia, 2013.Google Scholar
- K. Deb. Multi-Objective Optimization using Evolutionary Algorithms. Wiley-Interscience Series in Systems and Optimization. John Wiley and Sons, Chichester, 2001. Google ScholarDigital Library
- K. Deb, L. Thiele, M. Laumanns, and E. Zitzler. Scalable multi-objective optimization test problems. volume 1, pages 825--830, 2002.Google Scholar
- M.T. Emmerich, K. Giannakoglou, and B. Naujoks. Single- and multiobjective evolutionary optimization assisted by gaussian random field metamodels. IEEE Trans. Evolutionary Computation, 10(4):421--439, 2006. Google ScholarDigital Library
- A. Gaspar-Cunhaa and A. Vieira. A multi-objective evolutionary algorithm using neural networks to approximate fitness evaluations. International Journal of Computers, Systems, and Signals, 6(1):18--36, 2005.Google Scholar
- R. L. Iman and W. J. Conover. A distribution-free approach to inducing rank correlation among input variables. Communication in Statistics, B11(3):311--334, 1982.Google ScholarCross Ref
- Y. Jin. A comprehensive survey of fitness approximation in evolutionary computation. Soft Computing, 9(1):3--12, 2005. Google ScholarDigital Library
- Y. Jin, M. Olhofer, and B. Sendhoff. Managing approximate models in evolutionary aerodynamic design optimization. In In Proceedings of IEEE Congress on Evolutionary Computation, pages 592--599. IEEE Press, 2001.Google Scholar
- Y. Jin, M. Olhofer, and B. Sendhoff. A framework for evolutionary optimization with approximate fitness functions. IEEE Transactions on Evolutionary Computation, 6(5):481--494, 2002. Google ScholarDigital Library
- S. Z. Martinez and C. A. Coello Coello. Moea/d assisted by rbf networks for expensive multi-objective optimization problems. In Christian Blum and Enrique Alba, editors, GECCO, pages 1405--1412. ACM, 2013. Google ScholarDigital Library
- C. L. Mumford. Simple population replacement strategies for a steady-state multi-objective evolutionary algorithm. In Genetic and Evolutionary Computation Conference, pages 1389--1400. Springer, juin 2004.Google ScholarCross Ref
- Y. S. Ong, A. J. Keane, and P. B. Nair. Evolutionary optimization of computationally expensive problems via surrogate modeling. American Institute of Aeronautics and Astronautics Journal, 41(4):687--696, 2003.Google ScholarCross Ref
- A. OSYCZKA. Multicriteria optimization for engineering design. In Design Optimization, J. S. Gero, Ed. Academic Press, Inc., New York, NY,, pages 193--227, 1985.Google Scholar
- L. V. Santana-Quintero, A. A. Montano, and C. A. Coello Coello. A review of techniques for handling expensive functions in evolutionary multi-objective optimization, chapter 1, pages 29--59. Berlin: Springer-Verlag, 2010.Google Scholar
- H. Sobieczky. Parametric airfoils and wings. In Kozo Fujii and GeorgeS Dulikravich, editors, Recent Development of Aerodynamic Design Methodologies, volume 65 of Notes on Numerical Fluid Mechanics (NNFM), pages 71--87. Vieweg+Teubner Verlag, 1999.Google Scholar
- A. Szollos, M. Smid, and J. Hajek. Aerodynamic optimization via multi-objective micro-genetic algorithm with range adaptation, knowledge-based reinitialization, crowding and epsilon-dominance. Advances in Engineering Software, 40:419--430, 2009. Google ScholarDigital Library
- D. Verbeeck, F. Maes, K. D. Grave, and H. Blockeel. Multi-objective optimization with surrogate trees. In GECCO, pages 679--686. ACM, 2013. Google ScholarDigital Library
- G. D. Wyss and K. H. Jorgensen. A user's guide to lhs: Sandia's latin hypercube sampling software. Technical report, SAND98-0210. Sandia National Laboratories, Albuquerque, NM., 1998.Google Scholar
- Q. Zhang, W. Liu, E. Tsang, and B. Virginas. Expensive multiobjective optimization by moea/d with gaussian process model. IEEE Trans. Evolutionary Computation, 14(3):456--474, 2010. Google ScholarDigital Library
- E. Zitzler, K. Deb, and L. Thiele. Comparison of multiobjective evolutionary algorithms: Empirical results. Evolutionary Computation, 8:173--195, 2000. Google ScholarDigital Library
- E. Zitzler, L. Thiele, M. Laumanns, C. M. Fonseca, and V. G. da Fonseca. Performance assessment of multiobjective optimizers: An analysis and review. IEEE Transactions on Evolutionary Computation, 7(2):117--132, 2003. Google ScholarDigital Library
Index Terms
- Steady state IBEA assisted by MLP neural networks for expensive multi-objective optimization problems
Recommendations
A hybrid method for solving multi-objective global optimization problems
AbstractReal optimization problems often involve not one, but multiple objectives, usually in conflict. In single-objective optimization there exists a global optimum, while in the multi-objective case no optimal solution is clearly defined but rather a ...
A numerical method for constructing the Pareto front of multi-objective optimization problems
In this paper, a new numerical method is presented for constructing an approximation of the Pareto front of multi-objective optimization problems. This method is based on the well-known scalarization approach by Pascoletti and Serafini. The proposed ...
Multi-objective optimization using teaching-learning-based optimization algorithm
Two major goals in multi-objective optimization are to obtain a set of nondominated solutions as closely as possible to the true Pareto front (PF) and maintain a well-distributed solution set along the Pareto front. In this paper, we propose a teaching-...
Comments