Abstract
This paper investigates how a local search metaheuristic for continuous optimisation can be adapted so that it finds broad peaks, corresponding to robust solutions. This is relevant in problems in which uncertain or noisy data is present. When using a genetic or evolutionary algorithm, it is standard practice to perturb solutions once before evaluating them, using noise from a given distribution. This approach however, is not valid when using population-less techniques like local search and other heuristics that use local search. For those algorithms to find robust solutions, each solution needs to be perturbed and evaluated several times, and these evaluations need to be combined into a measure of robustness. In this paper, we examine how many of these evaluations are needed to reliably find a robust solution. We also examine the effect of the parameters of the noise distribution. Using a simple tabu search procedure, the proposed approach is tested on several functions found in the literature.
Similar content being viewed by others
References
Aizawa, A. N. and Wah, B. W.: Scheduling of genetic algorithms in a noisy environment, Evol. Comput. 2 (1994), 97–122.
Arnold, D. V.: Evolution strategies in noisy environments-a survey of existing work, In: L. Kallel, B. Naudts and A. Rogers (eds), Theoretical Aspects of Evolutionary Computing, Springer, Berlin, 2001, pp. 239–249.
Beyer, H.-G., Olhofer, M. and Sendhoff, B.: On the behavior of (µ/µ I , ?)-ES optimizing functions disturbed by generalized noise, In: K. A. De Jong, R. Poli and J. Rowe (eds), Foundations of Genetic Algorithms 7 (FOGA 2002), Morgan Kaufmann, San Francisco CA, 2003, pp. 307–328.
Branke, J.: Creating robust solutions by means of evolutionary algorithms, In: A. E. Eiben, T. Bäck, M. Schoenauer, and H.-P. Schwefel (eds), Parallel Problem Solving from Nature V, Lecture Notes in Comput. Sci. 1498, Springer, Berlin, 1998, pp. 119–128.
Branke, J.: Evolutionary Optimization in Dynamic Environments, Kluwer Acad. Publ., Dordrecht, 2001.
Branke, J.: Reducing the sampling variance when searching for robust solutions, In: L. Spector et al. (eds), GECCO 2001-Proceedings of the Genetic and Evolutionary Computation Conference, Morgan Kaufmann, 2001, pp. 235–242.
Fitzpatrick, J. M. and Grefenstette, J. J.: Genetic algorithms in noisy environments, Machine Learning 3 (1988), 101–120.
Glover, F. and Hanafi, S.: Tabu search and finite convergence, Technical Report HCES-04-99, Hearin Centre for Entreprise Research, 1999.
Hunter, D.: An upper bound for the probability of a union, J. Appl. Probab. 13 (1976), 597–603.
Parmee, I. C.: The maintenance of search diversity for effective design space decomposition using cluster oriented genetic algorithms (COGAs) and multi-agent strategies (GAANT), In: I. C. Parmee (eds), Proceedings of Adaptive Computing in Engineering Design and Control, Plymouth, 1996, pp. 128–138.
Reeves, C. R.: A genetic algorithm approach to stochastic flowshop sequencing. In: Proceedings of the IEE Colloquium on Genetic Algorithms for Control and Systems Engineering, volume Digest No. 1992/106, London, 1992, pp. 131–134.
Sedgewick, R.: Algorithms, Addison-Wesley, New York, 1988.
Stagge, P.: Averaging efficiently in the presence of noise, In: A. E. Eiben, T. Bäck, M. Schoenauer and H.-P. Schwefel (eds), Parallel Problem Solving from Nature V, Lecture Notes in Comput. Sci. 1498, Springer, Berlin, 1998, pp. 188–197.
Tsutsui, S.: A comparative study on the effects of adding perturbations to phenotypic parameters in genetic algorithms with a robust solution searching scheme, In: Proceedings of the 1999 IEEE Systems, Man, and Cybernetics Conference (SMC'99 Tokyo), 1999, pp. III-585-591.
Tsutsui, S. and Ghosh, A.: Genetic algorithms with a robust solution searching scheme, IEEE Trans. Evolut. Comput. 1 (1997), 201–208.
Tsutsui, S., Ghosh, A. and Fujimoto, Y.: A robust solution searching scheme in genetic search, In: H.-M. Voigt, W. Ebeling, I. Rechenberg and H.-P. Schwefel (eds), Parallel Problem Solving from Nature-PPSN IV, Vol. 10, Springer, Berlin, 1996, pp. 543–552.
Wiesmann, D., Hammel, U. and Bäck, T.: Robust design of multilayer optical coatings by means of evolutionary algorithms, IEEE Trans. Evolut. Comput. 2 (1998), 162–167.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sörensen, K. Finding Robust Solutions Using Local Search. Journal of Mathematical Modelling and Algorithms 3, 89–103 (2004). https://doi.org/10.1023/B:JMMA.0000026710.74315.3e
Issue Date:
DOI: https://doi.org/10.1023/B:JMMA.0000026710.74315.3e