Abstract
The quality of an approximate solution for combinatorial optimization problems with a single objective can be evaluated relatively easily. However, this becomes more difficult when there are multiple objectives. One potential approach to solving multiple criteria combinatorial optimization problems when at least one of the single objective problems is NP-complete, is to use an a posteriori method that approximates the efficient frontier. A common difficulty in this type of approach, however, is evaluating the quality of approximate solutions, since sets of multiple solutions should be evaluated and compared. This necessitates the use of a comparison measure that is robust and accurate. Furthermore, a robust measure plays an important role in metaheuristic optimization for “tuning” various parameters for evolutionary algorithms, simulated annealing, etc., which are frequently employed for multiple criteria combinatorial optimization problems. In this paper, the performance of a new measure, which we call Integrated Convex Preference (ICP) is compared to that of other measures appearing in the literature through numerical experiments—specifically, we use two a posteriori solution techniques based on genetic algorithms for a bi-criteria parallel machine scheduling problem and evaluate their performance (in terms of solution quality) using different measures. Experimental results show that the ICP measure evaluates the solution quality of approximations robustly (i.e., similar to visual comparison results) while other alternative measures can misjudge the solution quality. We note that the ICP measure can be applied to other non-scheduling multiple objective combinatorial optimization problems, as well.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Carlyle, W. M. J. W. Fowler E. Gel and B. Kim “Evaluating the quality of approximate solution sets for multiple objective optimization problems” Decision Sciences, 34(1), 63–82 (2003).
Cieniawski, S. E. J. W. Eheart and S. Ranjithan “Using genetic algorithms to solve a multi-objective groundwater monitoring problem” Water Resources Research, 31(2), 399–409 (1995).
Cochran, J. K. S.-M. Horng and J. W. Fowler “A multi-population genetic algorithm to solve multi-objective scheduling problems for parallel machines” Computers & Operations Research, 30(7), 1087–1102 (2003).
Cunha, A. G. P. Oliveira and J. A. Covas “Use of genetic algorithms in multicriteria optimization to solve industrial problems” in Proceeding of International Conference on Genetic Algorithms, 1997, pp. 682–688.
Czyzak, P. and A. Jaszkiewicz “Pareto simulated annealing—A metaheuristic technique for multiple-objective combinatorial optimization” Journal of Multi-Criteria Decision Analysis, 7, 34–47 (1998).
Daniels, R. L. in “Analytical evaluation of multi-criteria heuristics” Management Science, 38(4), 501–513 (1992).
De, P. J. B. Ghosh and C. E. Wells “Heuristic estimation of the efficient frontier for a bi-criteria scheduling problem” Decision Sciences, 23, 596–609 (1992).
Fonseca, C. M. and P. J. Fleming “Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization” Proceeding of International Conference on Genetic Algorithms, 1993, pp. 416–423.
Fry, T. D. R. D. Armstrong and H. Lewis “A framework for single machine multiple objective sequencing research” Omega International Journal of Management Science, 17(6), 594–607 (1989).
Hansen, P. and A. Jaszkiewiecz “Evaluating the quality of approximations to the non-dominated set. Institute of mathematical modeling” Technical University of Denmark, Lyngby. {Technical Report} 1998, IMM-REP-1998-7.
Hyun, C. J. Y. Kim and Y. K. Kim “A genetic algorithm for multiple objective sequencing problems in mixed model assembly lines” Computers & Operations Research, 25(7/8), 675–690 (1998).
Lee, C.-Y. and G. L. Vairaktarakis “Complexity of single machine hierarchical scheduling: A survey in complexity in numerical optimization” P. M. Pardalos (ed.), World Scientific Publishing, 1993, pp. 269–298.
Loughlin, D. H. and S. Ranjithan “The neighborhood constraint method: A genetic algorithm-based multiobjective optimization technique” in Proceeding of International Conference on Genetic Algorithms, 1997, pp. 666–673.
Louis, S. J. and G. J. E. Rawlins “Pareto-optimality, GA-easiness and deception” in Proceeding of International Conference on Genetic Algorithms, 1993, pp. 118–123.
Marett, R. and M. Wright “A comparison of neighborhood search techniques for multi-objective combinatorial problems” Computers & Operations Research, 23(5), 465–483 (1996).
Miettinen, K. M. Nonlinear Multiobjective Optimization, Kluwer Academic, Boston, 1999.
Murata, T. H. Ishibuchi and H. Tanaka “Multi-objective genetic algorithm and its application to flowshop scheduling” Computers Industrial Engineering, 30(4), 957–968 (1996).
Nelson, R. T. R. K. Sarin and R. L. Daniels “Scheduling with multiple performance measures: The one-machine case” Management Science, 32(4), 464–479 (1986).
Pinedo, M. Scheduling: Theory, Algorithms, and Systems, Prentice Hall, New Jersey, 1995.
Schaffer, J. D. “Multiple objective optimization with vector evaluated genetic algorithms” in Proceeding of the First International Conference on Genetic Algorithms, 1985, pp. 93–100.
Schenkerman, S. “Relative objective functions in multiobjective decision support models” Decision Sciences, 21, 727–737 (1990).
Serifoglu, F. S. and G. Ulusoy “Parallel machine scheduling with earliness and tardiness penalties” Computers & Operations Research, 26, 773–787 (1999).
Tuzikov, A. M. Makhaniok and R. Manner “Bicriteria scheduling of identical processing time jobs by uniform processors” Computers & Operations Research, 25(1), 31–35 (1998).
Viana, A. and J. P. Sousa “Using metaheuristics in multi-objective resource constrained project scheduling” European Journal of Operational Research, 120, 359–374 (2000).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fowler, J.W., Kim, B., Carlyle, W.M. et al. Evaluating solution sets of a posteriori solution techniques for bi-criteria combinatorial optimization problems. J Sched 8, 75–96 (2005). https://doi.org/10.1007/s10951-005-5316-4
Issue Date:
DOI: https://doi.org/10.1007/s10951-005-5316-4