Abstract
Research on multiobjective optimization is very active currently because most of the real-world engineering optimization problems are multiobjective in nature. Multiobjective optimization does not restrict to find a unique single solution, but a set of solutions collectively known as the Pareto front. Evolutionary algorithms (EAs) are especially well-suited for solving such kind of problems because they are able to find multiple trade-off solutions in a single run. However, these algorithms may be computationally expensive because (1) real-world problem optimization typically involves tasks demanding high computational resources and (2) they are aimed at finding the whole front of optimal solutions instead of searching for a single optimum. Parallelizing EAs arises as a possible way of facing this drawback. The first goal of this chapter is to provide the reader with a wide overview of the literature on parallel EAs for multiobjective optimization. Later, we include an experimental study where we develop and analyze pPAES, a parallel EA for multiobjective optimization based on the Pareto Archived Evolution Strategy (PAES). The obtained results show that pPAES is a promising option for solving multiobjective optimization problems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D.K. Agrafiotis. Multiobjective Optimization of Combinatorial Libraries. IBM J. RES. & DEV., 45(3/4):545–566, 2001.
A. Al-Yamani, S. Sait, and H. Youssef. Parallelizing Tabu Search on a Cluster of Heterogeneous Workstations. Journal of Heuristics, 8(3):277–304, 2002.
A. Al-Yamani, S.M. Sait, H. Barada, and H. Youssef. Parallel Tabu Search in a Heterogeneous Environment. In Proc. of the Int. Parallel and Distributed Processing Symp., pages 56–63, 2003.
A. Al-Yamani, S.M. Sait, and H.R. Barada. HPTS: Heterogeneous Parallel Tabu Search for VLSI Placement. In Proc. of the 2002 Congress on Evolutionary Computation, pages 351–355, 2002.
E. Alba, editor. Parallel Metaheuristics: A New Class of Algorithms. John Wiley & Sons, 2005.
E. Alba and M. Tomassini. Parallelism and Evolutionary Algorithms. IEEE Transactions on Evolutionary Computation, 6(5):443–462, 2002.
E. Alba and J.M. Troya. A Survey of Parallel Distributed Genetic Algorithms. Complexity, 4(4):31–52, 1999.
G. Aloisio, E. Blasi, M. Cafaro, I. Epicoco, S. Fiore, and S. Mocavero. A Grid Environment for Diesel Engine Chamber Optimization. In Proc. of ParCo2003, 2003.
M. Basseur, J. Lemesre, C. Dhaenens, and E.-G. Talbi. Cooperation Between Branch and Bound and Evolutionary Approaches to Solve a Biobjective Flow Shop Problem. In Workshop on Evolutionary Algorithms (WEA ′04), pages 72–86, 2004.
C.P. Bottura and J.V. da Fonseca Neto. Rule-Based Decision-Making Unit for Eigenstruture Assignment via Parallel Genetic Algorithm and LQR, Designs. In Proc. of the American Control Conference, pages 467–471, 2000.
J. Branke, H. Schmeck, K. Deb, and M. Reddy S. Parallelizing Multi-Objective Evolutionary Algorithms: Cone Separation. In Congress on Evolutionary Computation (CEC ′2004), pages 1952–2957, 2004.
E. Cantú-Paz. Efficient and Accurate Parallel Genetic Algorithms. Kluwer Academic Publisher, 2000.
C.S. Chang and J.S. Huang. Optimal Multiobjective SVC Planning for Voltage Stability Enhancement. IEE Proc.-Generation, Transmission, and Distribution, 145(2):203–209, 1998.
C.A. Coello and M. Reyes. A Study of the Parallelization of a Coevolutionary Multi-Objective Evolutionary Algorithm. In MICAI 2004, LNAI 2972, pages 688–697, 2004.
C.A. Coello and G. Toscano. Multiobjective Optimization Using a Micro-Genetic Algorithm. In GECCO-2001, pages 274–282, 2001.
C.A. Coello, D.A. Van Veldhuizen, and G.B. Lament. Evolutionary Algorithms for Solving Multi-Objective Problems. Kluwer Academic Publishers, 2002.
M. Conti, S. Orcioni, and C. Turchetti. Parametric Yield Optimisation of MOS VLSI Circuits Based on Simulate Annealing and its Parallel Implementation. IEE Proc.-Circuits Devices Syst., 141(5):387–398, 1994.
J.V. da Fonseca Neto and C.P. Bottura. Parallel Genetic Algorithm Fitness Function Team for Eigenstructure Assignment via LQR, Designs. In Proc. of the 1999 Congress on Evolutionary Computation, pages 1035–1042, 1999.
A. de Risi, T. Donateo, D. Laforgia, G. Aloisio, E. Blasi, and S. Mocavero. An Evolutionary Methodology for the Design of a D.I. Combustion Chamber for Diesel Engines. In Conf. on Thermo- and Fluid Dynamics Processes in Diesel Engines (THIESEL 2004), 2004.
F. de Toro, J. Ortega, J. Fernández, and A. Díaz. PSFGA: A Parallel Genetic Algorithm for Multiobjective Optimization. In Proc. of the 10th Euromicro Workshop on Parallel, Distributed and Network-Based Processing, pages 384–391, 2002.
F. de Toro, J. Ortega, and B. Paechter. Parallel Single Front Genetic Algorithm: Performance Analysis in a Cluster System. In Proc. of the Int. Parallel and Distributed Processing Symp. (IPDPS’OS), page 143, 2003.
F. de Toro, J. Ortega, E. Ros, S. Mota, B. Paechter, and J.M. Martín. PSFGA: Parallel Processing and Evolutionary Computation for Multiobjective Optimisation. Parallel Computing, 30(5-6):721–739, 2004.
K. Deb. Multi-Objective Optimization Using Evolutionary Algorithms. Wiley, 2001.
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Trans, on Evolutionary Computation, 6(2):182–197, 2002.
K. Deb, P. Zope, and A. Jain. Distributed Computing of Pareto-Optimal Solutions Using Multi-Objective Evolutionary Algorithms. KanGAL 2002008, Indian Institute of Technology Kampur, 2002.
K. Deb, P. Zope, and A. Jain. Distributed Computing of Pareto-Optimal Solutions Using Multi-Objective Evolutionary Algorithms. In EMO 2003, LNCS 2632, pages 534–549, 2003.
P. Delisle, M. Krajecki, M. Gravel, and C. Gagn. Parallel Implementation of an Ant Colony Optimization Metaheuristic with OpenMP. In Proc. of the 3rd European Workshop on OpenMP (EWOMP01), 2001.
D.J. Doorly and J. Peiró. Supervised Parallel Genetic Algorithms in Aerodynamic Optimisation. In Proc. of the 13th AIAA CFD Conference, pages 210–216, 1997.
D.J. Doorly, J. Peiró, and J.-P. Oesterle. Optimisation of Aerodynamic and Coupled Aerodynamic-Structural Design Using Parallel Genetic Algorithms. In Proc. of the Sixth AIAA/NASA/USAF Multidiscipliary Analysis and Optimization Symp., pages 401–409, 1996.
D.J. Doorly, S. Spooner, and J. Peiró. Supervised Parallel Genetic Algorithms in Aerodynamic Optimisation. In EvoWorkshops 2000, LNCS 1803, pages 357–366, 2000.
S. Duarte and B. Barán. Multiobjective Network Design Optimisation Using Parallel Evolutionary Algorithms. In XXVII Conferencia Latinoamericana de Informática CLEI’ 2001, 2001.
P. Eberhard, F. Dignath, and L. Kübler. Parallel Evolutionary Optimization of Multibody Systems with Application to Railway Dynamics. Multibody Systems Dynamics, 9:143–164, 2003.
C.M. Fonseca and P. Fleming. Genetic Algorithms for Multiobjective Optimization: Formulation, Discussion and Generalization. In Proc. of the 5th Int. Conf. on Genetic Algorithms, pages 416–423, San Mateo, CA, 1993.
C.M. Fonseca and P.J. Flemming. Multiobjective Optimization and Multiple Constraint Handling with Evolutionary Algorithms – Part II: Application Example. IEEE Transactions on System, Man, and Cybernetics, 28:38–47, 1998.
A. Geist, W. Jiang R. Manchek A. Beguelin, J. Dongarra, and V. Sunderam. PVM: Parallel Virtual Machine. The MIT Press, 1994.
T. Goel, R,. Vaidyanathan, R,. Haftka, and W. Shyy. Response Surface Approximation of Pareto Optimal Front in Multi-objective Optimization. In 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, 2004.
I.E. Golovkin, S. J. Louis, and R,.C. Mancini. Parallel Implementation of Niched Pareto Genetic Algorithm Code for X-Ray Plasma Spectroscopy. In Proc. of the 2002 Congress on Evolutionary Computation, pages 1820–1824, 2002.
I.E. Golovkin, R.C. Mancini, and S. J. Louis. Parallel Implementation of Niched Pareto Genetic Algorithm Code for X-Ray Plasma Spectroscopy. In Late-Breaking Papers at the 2000 Genetic and Evolutionary Computation Conference, 2000.
W. Gropp, E. Lusk, and A. Skjellum. Using MPI: Portable Parallel Programming with the Message-passing Interface. The MIT Press, London, UK, 2000.
T. Hiroyasu. Diesel Engine Design Using Multi-Objective Genetic Algorithm. In Japan/US Workshop on Design Environment 2004, 2004.
T. Hiroyasu, M. Miki, M. Kim, S. Watanabe, H. Hiroyasu, and H. Miao. Reduction of Heavy Duty Diesel Engine Emission and Fuel Economy with Multi-Objective Genetic Algorithm and Phenomenological Model. SAE Paper SP-1824, 2004.
T. Hiroyasu, M. Miki, and S. Watanabe. Divided Range Genetic Algorithms in Multiobjective Optimization Problems. In Proc. of Int. Workshop on Emergent Synthesis, I WES ′ 99, pages 57–66, 1999.
T. Hiroyasu, M. Miki, and S. Watanabe. The New Model of Parallel Genetic Algorithm in Multi-Objective Optimization Problems – Divided Range Multi-Objective Genetic Algorithm –. In 2000 IEEE Congress on Evolutionary Computation, pages 333–340, 2000.
H. Horii, M. Miki, T. Koizumi, and N. Tsujiuchi. Asynchronous Migration of Island Parallel GA For Multi-Objective Optimization Problem. In Proc. of the 4th Asia-Pacific Conf. on Simulated Evolution and Learning (SEAL ′02), pages 86–90, 2002.
J. Horn, N. Nafpliotis, and D.E. Goldberg. A Niched Pareto Genetic Algorithm for Multi-Objective Optimization. In Proc. of the 1st IEEE Conf. on Evolutionary Computation, pages 82–87, 1994.
D. Jaeggi, C. Asselin-Miller, G. Parks, T. Kipouros, T. Bell, and J. Clarkson. Multi-Objective Parallel Tabu Search. In Parallel Problem Solving from Nature (PPSN VIII), LNCS 3242, pages 732–741, 2004.
D. Jaeggi, G. Parks, T. Kipouros, and J. Clarkson. A Multi-Objective Tabu Search Algorithm for Constrained Optimisation Problems. In Third Int. Conf. on Evolutionary Multi-Criterion Optimization (EMO ′05), LNCS 3410, pages 490–504, 2005.
B.R. Jones, W.A. Crossley, and A.S. Lyrintzis. Aerodynamic and Aeroacoustic Optimization of Airfoils Via a Parallel Genetic Algorithm. In Proc. of the 7th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis and Optimization, 1998.
N. Jozefowiez, F. Semet, and E.-G. Talbi. Parallel and Hybrid Models for Multi-Objective Optimization: Application to the Vehicle Routing Problem. In Parallel Problem Solving from Nature (PPSN VII), pages 271–280, 2002.
J. Kamiura, T. Hiroyasu, M. Miki, and S. Watanabe. MOGADES: Multi-Objective Genetic Algorithm with Distributed Environment Scheme. In Proc. of the 2nd Int. Workshop on Intelligent Systems Design and Applications (ISDA ′02), pages 143–148, 2002.
M. Kanazaki, M. Morikawa, S. Obayashi, and K. Nakahashi. Multiobjective Design Optimization of Merging Configuration for an Exhaust Manifold of a Car Engine. In Parallel Problem Solving from Nature (PPSN VII), pages 281–287, 2002.
N. Keerativuttitumrong, C. Chaiyaratana, and V. Varavithya. Multi-Objective Co-Operative Co-Evolutionary Genetic Algorithm. In Parallel Problem Solving from Nature (PPSN VII), pages 288–297, 2002.
M.P. Kleeman, R.O. Day, and G.B. Lamont. Analysis of a Parallel MOEA Solving the Multi-Objective Quadratic Assignment Problem. In GECCO 2004, LNCS 3103, pages 402–403, 2004.
M.R,. Knarr, M.N. Goltz, G.B. Lamont, and J. Huang. In Situ Bioremediation of Perchlorate-Contaminated Groundwater Using a Multi-Objective Parallel Evolutionary Algorithm. In Proc. of the 2003 Congress on Evolutionary Computation (CEC ′2003), pages 1604–1611, 2003.
J.D. Knowles and D.W. Corne. Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy. Evolutionary Computation, 8(2):149–172, 2000.
F. Kursawe. A Variant of Evolution Strategies for Vector Optimization. In H.P. Schwefel and R. Männer, editors, Parallel Problem Solving for Nature, pages 193–197, Berlin, Germany, 1990. Springer-Verlag.
J. Lemesre, C. Dhaenens, and E.-G. Talbi. A Parallel Exact Method for a Bicriteria Permutation Flow-Shop Problem. In Project Management and Scheduling (PMS ′04), pages 359–362, 2004.
J. Lienig. A Parallel Genetic Algorithm for Performance-Driven VLSI Routing. IEEE Trans, on Evolutionary Computation, l(l):29–39, 1997.
D.A. Linkens and H. Okola Nyongesa. A Distributed Genetic Algorithm for Multivariable Fuzzy Control. In IEE Colloquium on Genetic Algorithms for Control Systems Engineering, pages 9/1–9/3, 1993.
R.A.E. Mäkinen, P. Neittaanmäki, J. Periaux, M. Sefrioui, and J. Toivanen. Parallel Genetic Solution for Multobjective MDO. In Parallel CFD ′96 Conference, pages 352–359, 1996.
J.M. Malard, A. Heredia-Langner, D.J. Baxter, K.H. Jarman, and W.R. Cannon. Constrained De Novo Peptide Identification via Multi-Objective Optimization. In Online Proc. of the Third IEEE Int. Workshop on High Performance Computational Biology (HiCOMB 2004), 2004.
S. Manos and L. Poladian. Novel Fibre Bragg Grating Design Using Multiobjective Evolutionary Algorithms. In Proc. of the 2003 Congress on Evolutionary Computation (CEC ′2003), pages 2089–2095, 2003.
N. Marco and S. Lanteri. A Two-Level Parallelization Strategy for Genetic Algorithms Applied to Optimum Shape Design. Parallel Computing, 26:377–397, 2000.
J. Mehnen, T. Michelitsch, K. Schmitt, and T. Kohlen. pMOHypEA: Parallel Evolutionary Multiobjective Optimization using Hypergraphs. Technical Report CI-187/05, Universität Dortmund, 2005.
H. Meunier, E.-G. Talbi, and P. Reininger. A Multiobjective Genetic Algorithm for Radio Network Design. In Proc. of the 2000 Congress on Evolutionary Computation, pages 317–324, 2000.
A.J. Nebro, E. Alba, and F. Luna. Multi-Objective Optimization Using Grid Computing. Soft Computing Journal, 2005. To appear.
S. Obayashi, D. Sasaki, Y. Takeguchi, and N. Hirose. Multiobjective Evolutionary Computation for Supersonic Wing-Shape Optimization. IEEE Trans, on Evolutionary Computation, 4(2):182–187, 2000.
S. Obayashi, T. Tsukahara, and T. Nakamura. Cascade Airfoil Design by Multiobjective Genetic Algorithms. In Second Int. Conf. on Genetic Algorithms in Engineering Systems: Innovations and Applications, pages 24–29, 1997.
S. Obayashi, T. Tsukahara, and T. Nakamura. Multiobjective Genetic Algorithm Applied to Aerodynamic Design of Cascade Arfoils. IEEE Trans, on Industrial Electronics, 47(1):211–216, 2000.
C.K. Oh and G.J. Barlow. Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming. In Proceedings of the 2004 IEEE Congress on Evolutionary Computation, pages 1538–1545, 2004.
L.S. Oliveira, R. Sabourin, F. Bortolozzi, and C.Y. Suen. A Methodology for Feature Selection Using Multiobjective Genetic Algorithms for Handwritten Digit String Recognition. Int. Journal of Pattern Recognition and Artificial Intelligence, 17(6):903–929, 2003.
A. Osyczka. Multicriteria Optimization for Engineering Design. Academic Press, 1985.
K.E. Parsopoulos, D.K. Tasoulis, N.G. Pavlidis, V.P. Plagianakos, and M.N. Vrahatis. Vector Evaluated Differential Evolution for Multiobjective Optimization. In Proc. of the IEEE 2004 Congress on Evolutionary Computation (CEC 2004), pages 204–211, 2004.
K.E. Parsopoulos, D.K. Tasoulis, and M.N. Vrahatis. Multiobjective Optimization Using Parallel Vector Evaluated Particle Swarm Optimization. In Proc. of the IASTED Int. Conf. on Artificial Intelligence and Applications (AIA 2004), pages 823–828, 2004.
C. Poloni, A. Giurgevich, L. Onesti, and V. Pediroda. Hybridization of a Multi-Objective Genetic Algorithm, a Neural Network and a Classical Optimizer for a Complex Design Problem in Fluid Dynamics. Computer Methods in Applied Mechanics and Engineering, 186:403–420, 2000.
D. Quagliarella and A. Vicini. Sub-Population Policies for a Parallel Multiobjective Genetic Algorithm with Application to Wing Design. In 1998 IEEE Int. Conf. On Systems, Man, And Cybernetics, pages 3142–3147, 1998.
P.W.W. Radtke, L.S. Oliveira, R. Sabouring, and T. Wong. Intelligent Zoning Design Using Multi-Objective Evolutionary Algorithms. In Proc. of the Seventh Int. Conf. on Document Analysis and Recognition (ICDAR 2003), pages 824–828, 2003.
J.L. Rogers. A Parallel Approach to Optimum Actuator Selection with a Genetic Algorithm. In AIAA Guidance, Navigation, and Control Conf., 2000.
J. R.owe, K. Vinsen, and N. Marvin. Parallel GAs for Multiobjective Functions. In Proc. of the 2nd Nordic Workshop on Genetic Algorithms and Their Applications (2NWGA), pages 61–70, 1996.
S.M. Sait, H. Youssef, H.R. Barada, and A. Al-Yamani. A Parallel Tabu Search Algorithm for VLSI Standard-Cell Placement. In ISCAS ′OO, pages 581–584, 2000.
D. Sasaki, M. Morikawa, S. Obayashi, and K. Nkahashi. Aerodynamic Shape Optimization of Supersonic Wings by Adaptive Range Multiobjective Genetic Algorithms. In First Int. Conf. on Evolutionary Multi-Criterion Optimization (EMO 2001), 2001.
J.D. Schaffer. Multiple Objective Optimization with Vector Evaluated Genetic Algorithms. PhD thesis, Vanderbilt University, Nashville, TN, USA, 1984.
T.J. Stanley and T. Mudge. A Parallel Genetic Algorithm for Multiobjetive Microprocessor Design. In Proc. of the Sixth Int. Conf. on Genetic Algorithms, pages 597–604, 1995.
G. Stehr, H. Graeb, and K. Antreich. Performance Trade-off Analysis of Analog Circuits by Normal-Boundary Intersection. In Proc. of the 40th Conference on Design automation, pages 958–963, 2003.
F. Streichert, H. Ulmer, and A. Zell. Parallelization of Multi-Objective Evolutionary Algorithms Using Clustering Algorithms. In Third Int. Conf. on Evolutionary Multi-Criterion Optimization (EMO ′05), LNCS 3410, pages 92–107, 2005.
K.C. Tan, Y.J. Yang, and T.H. Lee. A Distributed Cooperative Coevolutionary Algorithm for Multiobjective Optimization. In Proc. of the 2003 Congress on Evolutionary Computation (CEC ′2003), pages 2513–2520, 2003.
D.A. Van Veldhuizen and G.B. Lamont. Multiobjective Evolutionary Algorithm Test Suites. In Proc. of the 1999 ACM Symp. on Applied Computing, pages 351–357, 1999.
A. Vicini and D. Quagliarella. A Multiobjective Approach to Transonic Wing Design by Means of Genetic Algorithms. In NATO RTO AVT Symposium on Aerodynamic Design and Optimization, 1999.
J.F. Wang, J. Periaux, and M. Sefrioui. Parallel Evolutionary Algorithms for Optimization Problems in Aerospace Engineering. Journal of Computational and Applied Mathematics, 149:155–169, 2002.
S. Watanabe, T. Hiroyasu, and M. Miki. Parallel Evolutionary Multi-Criterion Optimization for Block Layout Problems. In 2000 Int. Conf. on Parallel and Distributed Processing Techniques and Applications (PDPTA ′2000), pages 667–673, 2000.
S. Watanabe, T. Hiroyasu, and M. Miki. Parallel Evolutionary Multi-Criterion Optimization for Mobile Telecommunication Networks Optimization. In Proc. of the EUROGEN′2001, pages 167–172, 2001.
M.M. Wiecek and H. Zhang. A Scalable Parallel Algorithm for Multiple Objective Linear Programs. ICASE 94-38, NASA, 1994.
N. Xiao and M. P. Armstrong. A Specialized Island Model and Its Applications in Multiobjective Optimization. In Genetic and Evolutionary Computation Conference (GECCO′03), LNCS 2724, pages 1530–1540, London, UK, 2003. Springer-Verlag.
S. Xiong and F. Li. Parallel Strength Pareto Multi-Objective Evolutionary Algorithm. In Proc. of the 2003 Congress on Evolutionary Computation (CEC′2003), pages 681–683, 2003.
D. Zaharie and D. Petcu. Adaptive Pareto Differential Evolution and Its Parallelization. In PPAM 2003, LNCS 3019, pages 261–268, 2004.
Z.-Y. Zhu and K.-S. Leung. Asynchronous Self-Adjustable Island Genetic Algorithm for Multi-Objective Optimization Problems. In Proc. of the 2002 Congress on Evolutionary Computation (CEC′2002), pages 837–842, 2002.
E. Zitzler, M. Laumanns, and L. Thiele. SPEA2: Improving the Strength Pareto Evolutionary Algorithm. Technical Report 103, Computer Engineering and Networks Laboratory (TIK), Swiss Federal Institute of Technology (ETH), Zurich, Switzerland, 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer
About this chapter
Cite this chapter
Luna, F., Nebro, A.J., Alba, E. (2006). Parallel Evolutionary Multiobjective Optimization. In: Nedjah, N., Mourelle, L.d., Alba, E. (eds) Parallel Evolutionary Computations. Studies in Computational Intelligence, vol 22. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-32839-4_2
Download citation
DOI: https://doi.org/10.1007/3-540-32839-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32837-7
Online ISBN: 978-3-540-32839-1
eBook Packages: EngineeringEngineering (R0)