Skip to main content
Log in

Use of a goal-constraint-based approach for finding the region of interest in multi-objective problems

  • Published:
Journal of Heuristics Aims and scope Submit manuscript

Abstract

This paper presents a hybrid approach that combines an evolutionary algorithm with a classical multi-objective optimization technique to incorporate the preferences of the decision maker into the search process. The preferences are given as a vector of goals, which represent the desirable values for each objective. The proposed approach enhances the goal-constraint technique in such a way that, instead of use the provided \(\varepsilon \) values to compute the upper bounds of the restated problem, it uses only the information of the vector of goals to generate the constraints. The bounds of the region of interest are obtained using an efficient constrained evolutionary optimization algorithm. Then, an interpolation method is placed in charge of populating such a region. It is worth noting that although goal-constraint is able to obtain the bounds of problems regardless of their number objectives, the interpolation method adopted in this paper is restricted to bi-objective problems. The proposed approach was validated using problems from the ZDT, DTLZ, and WFG benchmarks. In addition, it was compared with two well-known algorithms that use the g-dominance approach to incorporate the preferences of the decision maker. The results corroborate that the incorporation of a priori preferences into the proposed approach is useful to direct the search efforts towards the decision’s maker region of interest.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Without loss of generality, in this work we will refer only to minimization problems.

References

  • Allmendinger, R., Li, X., Branke, J.: Reference point-based particle swarm optimization using a steady-state approach. In: Li, X., Kirley, M., Zhang, M., Green, D., Ciesielski, V., Abbass, H., Michalewicz, Z., Hendtlass, T., Deb, K., Tan, K.C., Branke, J., Shi, Y. (eds.) Simulated Evolution and Learning, 7th International Conference, SEAL 2008, pp. 200–209, Lecture Notes in Computer Science, vol. 5361. Springer, Melbourne (2008)

  • Alves, M.J., Costa, J.P.: An exact method for computing the Nadir values in multiple objective linear programming. Eur. J. Oper. Res. 198(2), 637–646 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  • Becerra, R.L.: Algoritmos culturales aplicados a optimización con restricciones y optimización multiobjetivo. Master’s thesis, Electrical Engineering, CINVESTAV-IPN (2002)

  • Becerra, R.L., Coello, C.A.C.: Solving hard multiobjective optimization problems using \(\varepsilon \)-constraint with cultured differential evolution. In: Runarsson, T.P., Beyer, H.-G., Burke, E., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) Parallel Problem Solving from Nature—PPSN IX, 9th International Conference, pp. 543–552. Lecture Notes in Computer Science, vol. 4193 Springer, Reykjavik, September (2006)

  • Becerra, R.L., Coello, C.A.C., Hernández-Díaz, A.G., Caballero, R., Molina, J.: Alternative techniques to solve hard multi-objective optimization problems. In: Thierens, D. (ed.) 2007 Genetic and Evolutionary Computation Conference (GECCO’2007), vol. 1, pp. 757–764, ACM Press, London (2007)

  • Benayoun, R., de Montgolfier, J., Tergny, J., Laritchev, O.: Linear programming with multiple objective functions: step method (stem). Math. Program. 1(1), 366–375 (1971)

    Article  MathSciNet  MATH  Google Scholar 

  • Bechikh, S.: Incorporating decision maker’s preference information in evolutionary multi-objective optimization. Ph.D. thesis, High Institute of Management of Tunis, University of Tunis, Tunisia, (2013)

  • Branke, J., Deb, K., Dierolf, H., Osswald, M.: Finding knees in multi-objective optimization. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) Parallel Problem Solving from Nature—PPSN VIII, pp. 722–731. Springer, Berlin (2004)

    Chapter  Google Scholar 

  • Cagnina, L.C., Esquivel, S.C.: Solving hard multiobjective problems with a hybridized method. J. Comput. Sci. Technol. 10(3), 843–866 (2010)

    Google Scholar 

  • Coello, C.A.C., Pulido, G.T., Lechuga, M.S.: Handling multiple objectives with particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 256–279 (2004)

    Article  Google Scholar 

  • Coello, C.A.C., Lamont, G.B., Van Veldhuizen, D.A.: Evolutionary Algorithms for Solving Multi-objective Problems, 2nd edn. Springer, New York (2007). ISBN 978-0-387-33254-3

    MATH  Google Scholar 

  • Cohon, J.L., Marks, D.H.: A review and evaluation of multiobjective programing techniques. Water Resour. Res. 11(2), 208–220 (1975)

    Article  Google Scholar 

  • Corne, D.W., Knowles, J.D., Oates, M.J.: The pareto envelope-based selection algorithm for multiobjective optimization. In: Schoenauer, M., Deb, K., Rudolph, G., Yao, X., Lutton, E., Merelo, J.J., Schwefel, H.-P. (eds.) Proceedings of the Parallel Problem Solving from Nature VI Conference, pp. 839–848, Lecture Notes in Computer Science No. 1917 . Springer, Paris (2000)

  • Cvetković, D., Parmee, I.C.: Use of preferences for GA-based multi-objective optimisation. In: Proceedings of the 1st Annual Conference on Genetic and Evolutionary Computation, vol. 2, GECCO’99, pp. 1504–1509. Morgan Kaufmann Publishers Inc, San Francisco (1999)

  • Cvetković, D., Parmee, I.C.: Preferences and their application in evolutionary multiobjective optimisation. IEEE Trans. Evol. Comput. 6(1), 42–57 (2002)

    Article  Google Scholar 

  • Deb, K.: Solving goal programming problems using multi-objective genetic algorithms. In: Proceedings of the 1999 Congress on Evolutionary Computation—CEC99 (Cat. No. 99TH8406), vol. 1, p. 84 (1999)

  • Deb, K.: Multi-objective Optimization Using Evolutionary Algorithms. Wiley, Chichester (2001). ISBN 0-471-87339-X

    MATH  Google Scholar 

  • Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)

    Article  Google Scholar 

  • Deb, K., Thiele, L., Laumanns, M., Zitzler, E.: Scalable multi-objective optimization test problems. In: Congress on Evolutionary Computation (CEC’2002), vol. 1, pp. 825–830. IEEE Service Center , Piscataway, NJ (2002)

  • Deb, K., Sundar, J.: Reference point based multi-objective optimization using evolutionary algorithms. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, GECCO ’06, pp. 635–642. ACM , New York, NY (2006)

  • Deb, K., Kumar, A.: Interactive evolutionary multi-objective optimization and decision-making using reference direction method. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, GECCO ’07, pp. 781–788. ACM, New York, NY (2007)

  • Deb, K., Kumar, A.: Light beam search based multi-objective optimization using evolutionary algorithms. In: 2007 IEEE Congress on Evolutionary Computation, pp. 2125–2132 (2007)

  • Deb, Kalyan, Miettinen, Kaisa.: A review of nadir point estimation procedures using evolutionary approaches: a tale of dimensionality reduction. Technical report, 01 (2009)

  • Dessouky, M.I., Ghiassi, M., Davis, W.J.: Estimates of the minimum nondominated criterion values in multiple-criteria decision-making. Eng. Costs Prod. Econ. 10(2), 95–104 (1986)

    Article  Google Scholar 

  • Díaz-Manríquez, A., Pulido, G.T., Becerra, R.L.: A long-term memory approach for dynamic multiobjective evolutionary algorithms. In: ECTA and FCTA 2011—Proceedings of the International Conference on Evolutionary Computation Theory and Applications and the Proceedings of the International Conference on Fuzzy Computation Theory and Applications (Parts of the International Joint Conference on Computational Intelligence IJCCI 2011), Paris, France, 24–26 October, pp. 333–337 (2011)

  • Ehrgott, M., Tenfelde-Podehl, D.: Computation of ideal and nadir values and implications for their use in MCDM methods. Eur. J. Oper. Res. 151(1), 119–139 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  • Fernández, E., Leyva, J.C.: A method based on multiobjective optimization for deriving a ranking from a fuzzy preference relation. Eur. J. Oper. Res. 154(1), 110–124 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  • Fliege, J., Drummond, L.M.G., Svaiter, B.F.: Newton’s method for multiobjective optimization. SIAM J. Optim. 20(2), 602–626 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  • Fonseca, C.M., Fleming, P.J.: Genetic algorithms for multiobjective optimization: formulation discussion and generalization. In: Proceedings of the 5th International Conference on Genetic Algorithms, pp. 416–423. Morgan Kaufmann Publishers Inc, San Francisco, CA (1993)

  • Greenwood, G.W., Hu, X., D’Ambrosio, J.G.: Fitness functions for multiple objective optimization problems: combining preferences with pareto rankings. In: Belew, R.K., Vose, M.D. (eds.) FOGA, pp. 437–455. Morgan Kaufmann, Burlington (1996)

    Google Scholar 

  • Harada, K., Sakuma, J., Kobayashi, S.: Local search for multiobjective function optimization: pareto descent method. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, GECCO ’06, pp. 659–666. ACM, New York, NY (2006)

  • Hillermeier, C.: Nonlinear Multiobjective Optimization: A Generalized Homotopy Approach. International Series on Numerical Mathematics, vol. 25. Birkhäuser, Basel (2001)

    Book  MATH  Google Scholar 

  • Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence. MIT Press, Cambridge, MA (1992)

    Book  Google Scholar 

  • Horn, J., Nafpliotis, N., Goldberg, D.E.: A niched pareto genetic algorithm for multiobjective optimization. In: Proceedings of the First IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence, vol. 1, pp. 82–87. IEEE Service Center, Piscataway, NJ (1994)

  • Huband, S., Hingston, P., Barone, L., While, L.: A review of multiobjective test problems and a scalable test problem toolkit. IEEE Trans. Evol. Comput. 10(5), 477–506 (2006)

    Article  MATH  Google Scholar 

  • Jin, Y., Okabe, T., Sendho, B.: Adapting weighted aggregation for multiobjective evolution strategies. In: Zitzler, E., Thiele, L., Deb, K., Coello, C.A., Corne, D. (eds.) Evolutionary Multi-criterion Optimization, pp. 96–110. Springer, Berlin (2001)

  • Jin, Y., Sendhoff, B.: Incorporation of fuzzy preferences into evolutionary multiobjective optimization. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, GECCO’02, pp. 683–683. Morgan Kaufmann Publishers Inc, San Francisco, CA (2002)

  • Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)

  • Korhonen, P., Salo, S., Steuer, R.E.: A heuristic for estimating Nadir criterion values in multiple objective linear programming. Oper. Res. 45(5), 751–757 (1997)

    Article  MATH  Google Scholar 

  • Landa, R., Coello, C.A.C., Toscano-Pulido, G.: Goal-constraint: incorporating preferences through an evolutionary \(\epsilon \)-constraint based method. In: 2013 IEEE Congress on Evolutionary Computation (CEC’2013), pp. 741–747, Cancún, México, 20–23, IEEE Press, ISBN 978-1-4799-0454-9 (2013)

  • Lara, A., Sanchez, G., Coello, C.A.C., Schutze, O.: HCS: a new local search strategy for memetic multiobjective evolutionary algorithms. IEEE Trans. Evol. Comput. 14(1), 112–132 (2010)

    Article  Google Scholar 

  • Lárraga Maldonado, G.: Incorporating preferences through an evolutionary \(\varepsilon \)-constraint based method. Master’s thesis, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (2014)

  • Martín, A., Schütze, O.: Pareto tracer: a predictor–corrector method for multi-objective optimization problems. Eng. Optim. 50(3), 516–536 (2018)

    Article  MathSciNet  Google Scholar 

  • Martin, B., Goldsztejn, A., Granvilliers, L., Jermann, C.: On continuation methods for non-linear bi-objective optimization: towards a certified interval-based approach. J. Glob. Optim. 64(1), 3–16 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  • Metev, B., Vassilev, V.: A method for nadir point estimation in MOLP problems. Cybern. Inf. Technol. 3, 1 (2003)

    MathSciNet  Google Scholar 

  • Miettinen, K.: Nonlinear Multiobjective Optimization. International Series in Operations Research and Management Science. Kluwer Academics Publishers, Boston, MA (1998)

    Book  Google Scholar 

  • Molina, J., Santana, L.V., Hernández-Díaz, A.G., Coello, C.A.C., Caballero, R.: g-dominance: reference point based dominance for multiobjective metaheuristics. Eur. J. Oper. Res. 197(2), 685–692 (2009)

    Article  MATH  Google Scholar 

  • Pareto, V.: Cours d’Economie Politique. Droz, Geneve (1896)

    Google Scholar 

  • Ranjithan, S.R., Chetan, S.K., Dakshima, H.K.: Constraint method-based evolutionary algorithm (CMEA) for multiobjective optimization. In: Zitzler, E., Deb, K., Thiele, L., Coello, C.A.C., Corne, D. (eds.) First International Conference on Evolutionary Multi-criterion Optimization, pp. 299–313. Lecture Notes in Computer Science No. 1993, Springer (2001)

  • Rao, S.M.: Tchebycheff method-based evolutionary algorithm for multiobjective optimization. Ph.D. thesis, North Carolina State University (2003)

  • Rekiek, B., de Lit, P., Delchambre, A.: Hybrid assembly line design and user’s preferences. Int. J. Prod. Res. 40(5), 1095–1111 (2002)

    Article  MATH  Google Scholar 

  • Rudolph, G., Schütze, O., Grimme, C., Domínguez-Medina, C., Trautmann, H.: Optimal averaged hausdorff archives for bi-objective problems: theoretical and numerical results. Comput. Optim. Appl. 64(2), 589–618 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  • Ruiz, A.B., Saborido, R., Luque, M.: A preference-based evolutionary algorithm for multiobjective optimization: the weighting achievement scalarizing function genetic algorithm. J. Glob. Optim. 62(1), 101–129 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  • Said, L.B., Bechikh, S., Ghedira, K.: The r-dominance: a new dominance relation for interactive evolutionary multicriteria decision making. IEEE Trans. Evol. Comput. 14(5), 801–818 (2010)

    Article  Google Scholar 

  • Santana-Quintero, L.V., Ramírez-Santiago, N., Coello, C.A.C., Luque, J.M., Hernández-Díaz, A.G.: A new proposal for multiobjective optimization using particle swarm optimization and rough sets theory. In: Runarsson, T.P., Beyer, H.-G., Burke, E., Merelo-Guervós, J.J., Whitley, L.D., Yao, X. (eds.) Parallel Problem Solving from Nature—PPSN IX, Lecture Notes in Computer Science, vol. 4193, pp. 483–492. Springer, Berlin (2006)

  • Schaffer, J.D.: Multiple objective optimization with vector evaluated genetic algorithms. In: Proceedings of the 1st International Conference on Genetic Algorithms, pp. 93–100. L. Erlbaum Associates Inc, Hillsdale, NJ (1985)

  • Schütze, O., Dell’Aere, A., Dellnitz, M.: On continuation methods for the numerical treatment of multi-objective optimization problems. In: Branke, J., Deb, K., Miettinen, K., Steuer, R.E. (eds.) Practical Approaches to Multi-objective Optimization, Number 04461 in Dagstuhl Seminar Proceedings, Dagstuhl, Germany. Internationales Begegnungs- und Forschungszentrum für Informatik (IBFI), Schloss Dagstuhl, Germany (2005)

  • Schütze, O., Coello, C.A.C., Mostaghim, S., Talbi, E.-G., Dellnitz, M.: Hybridizing evolutionary strategies with continuation methods for solving multi-objective problems. Eng. Optim. 40(5), 383–402 (2008)

    Article  MathSciNet  Google Scholar 

  • Schütze, O., Esquivel, X., Lara, A., Coello, C.A.C.: Using the averaged Hausdorff distance as a performance measure in evolutionary multiobjective optimization. IEEE Trans. Evol. Comput. 16(4), 504–522 (2012)

    Article  Google Scholar 

  • Schütze, O., Hernández, V.A.S., Trautmann, H., Rudolph, G.: The hypervolume based directed search method for multi-objective optimization problems. J. Heuristics 22(3), 273–300 (2016)

    Article  Google Scholar 

  • Srigiriraju, K.C.: Noninferior surface tracing evolutionary algorithm (NSTEA) for multi objective optimization. Master’s thesis, North Carolina State University, Raleigh, NC (2000)

  • Srinivas, N., Deb, K.: Muiltiobjective optimization using nondominated sorting in genetic algorithms. Evol. Comput. 2(3), 221–248 (1994)

    Article  Google Scholar 

  • Thiele, L., Miettinen, K., Korhonen, P.J., Molina, J.: A preference-based evolutionary algorithm for multi-objective optimization. Evol. Comput. 17(3), 411–436 (2009)

    Article  Google Scholar 

  • Toscano, G., Landa, R., Lárraga, G., Leguizamón, G.: On the use of stochastic ranking for parent selection in differential evolution for constrained optimization. Soft Comput. 21, 1–17 (2016)

    Google Scholar 

  • Van Veldhuizen, D.A.: Multiobjective evolutionary algorithms: classifications, analyses, and new innovations. Ph.D. thesis, Department of Electrical and Computer Engineering. Graduate School of Engineering. Air Force Institute of Technology, Wright-Patterson AFB, Ohio (1999)

  • Wang, H.: Zigzag search for continuous multiobjective optimization. INFORMS J. Comput. 25(4), 654–665 (2013)

    Article  MathSciNet  Google Scholar 

  • Zhang, Q., Li, H.: MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans. Evol. Comput. 11(6), 712–731 (2007)

    Article  Google Scholar 

  • Zhang, X., Tian, Y., Jin, Y.: A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans. Evol. Comput. 19(6), 761–776 (2015)

    Article  Google Scholar 

  • Zitzler, E., Deb, K., Thiele, L.: Comparison of multiobjective evolutionary algorithms: empirical results. Evol. Comput. 8(2), 173–195 (2000)

    Article  Google Scholar 

  • Zitzler, E., Thiele, L.: Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans. Evol. Comput. 3(4), 257–271 (1999)

    Article  Google Scholar 

  • Zitzler, E., Künzli, S.: Indicator-based selection in multiobjective search. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) Parallel Problem Solving from Nature—PPSN VIII, pp. 832–842. Springer, Berlin (2004)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ricardo Landa.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Landa, R., Lárraga, G. & Toscano, G. Use of a goal-constraint-based approach for finding the region of interest in multi-objective problems. J Heuristics 25, 107–139 (2019). https://doi.org/10.1007/s10732-018-9387-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10732-018-9387-8

Keywords

Navigation