Skip to main content

A Parallel Ant Colony Optimization Algorithm Based on Crossover Operation

  • Chapter

Part of the book series: Natural Computing Series ((NCS))

Abstract

In this work, we introduce a new parallel ant colony optimization algorithm based on an ant metaphor and the crossover operator from genetic algorithms.The performance of the proposed model is evaluated usingwell-known numerical test problems and then it is applied to train recurrent neural networks to identify linear and nonlinear dynamic plants. The simulation results are compared with results using other algorithms.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Reeves CR (Ed.) (1995) Modern Heuristic Techniques for Combinatorial Optimization. McGraw-Hill: UK.

    Google Scholar 

  2. Corne D, Dorigo M, Glover F (Eds) (1999) New Ideas in Optimization, McGraw-Hill: UK.

    Google Scholar 

  3. Farmer JD, Packard NH, Perelson AS (1986) The Immune System, Adaptation, and Machine Learning. Physica, 22D:187–204

    MathSciNet  Google Scholar 

  4. Kalinli A, Karaboga D (2004) Training recurrent neural networks by using parallel tabu search algorithm based on crossover operation. Engineering Applications of Artificial Inteligence, 17(5):529–542

    Article  Google Scholar 

  5. Dorigo M, Maniezzo V, Colorni A (1991) Positive feedback as a search strategy. Technical Report No:91–016 Politecnico di Milano

    Google Scholar 

  6. Dorigo M, Maniezzo V, Colorni A (1996) The ant system: Optimization by a colony of cooperating agents. IEEE Trans. on Systems, Man and Cybernetics – Part B, 26(1):1–13

    Google Scholar 

  7. Christopher FH et al. (2001) Swarm intelligence: an application of social insect optimization techniques to the traveling salesman problem. Artificial Intelligence I

    Google Scholar 

  8. Bullnheimer B, Hartl RF, and Strauss C (1999) A new rank based version of the ant system, a computational study. Central European J for Operations Research and Economics, 7(1):25–38

    MATH  MathSciNet  Google Scholar 

  9. Stützle T, Hoos HH (1997) The MAX-MIN ant system and local search for the traveling salesman problem. In Baeck T, Michalewicz Z, Yao X, (Eds), Proc. of the IEEE Int. Conf. on Evolutionary Computation (ICEC’97):309–314

    Google Scholar 

  10. Gambardella LM, Dorigo M (1996) Solving symmetric and asymmetric TSPs by ant colonies. Proc. of IEEE Int. Conf. on Evolutionary Computation, IEEE-EC 96, Nagoya, Japan:622–627

    Google Scholar 

  11. Di Caro G, Dorigo M (1998) Mobile agents for adaptive routing. Proc. of 31st Hawaii Conf. on Systems Sciences (HICSS-31):74–83

    Google Scholar 

  12. Stützle T, Dorigo M (1999) ACO algorithms for quadratic assignment problem. in: Corne D, Dorigo M, Glover F (Eds), New Ideas in Optimization, McGraw-Hill:33–50

    Google Scholar 

  13. Gambardella LM, Taillard E, Agazzi G (1999) MACS-VRPTW: A multiple ant colony system for vehicle routing problems with time windows. Technical Report, IDSIA-06: Switzerland

    Google Scholar 

  14. Bilchev G, Parmee IC (1995) The ant colony metaphor for searching continuous design spaces. Lecture Notes in Computer Science, Springer-Verlag, LNCS 993:25–39

    Google Scholar 

  15. Monmarché N, Venturini G, Slimane M (2000) On how Pachycondyla apicalis ants suggest a new search algorithm. Future Generation Systems Computer 16(8):937–946

    Article  Google Scholar 

  16. Dreo J, Siarry P (2004) Continuous ant colony algorithm based on dense heterarchy. Future Generation Computer Systems, 20(5):841–856

    Article  Google Scholar 

  17. Hiroyasu T, Miki M, Ono Y, Minami Y (2000) Ant colony for continuous functions, The Science and Engineering, Doshisha University

    Google Scholar 

  18. Bullnheimer B, Kotsis G, Strauss C (1998) Parallelization strategies for the ant system. in: De Leone R, Murli A, Pardalos P, Toraldo G (Eds), High Performance Algorithms and Software in Nonlinear Optimization. Kluwer Series of Applied Optimization, Kluwer Academic Publishers, Dordrecht, The Netherlands, 24:87–100

    Google Scholar 

  19. Stützle T (1998) Parallelization strategies for ant colony optimization, in: Eiben AE, Back T, Schoenauer M, Schwefel HP (Eds), Fifth Int. Conf. on Parallel Problem Solving from Nature, Springer-Verlag: 1498:722–731

    Google Scholar 

  20. Middendorf M, Reischle F, Schmeck H (2000) Information exchange in multicolony algorithms. in: Rolim J, Chiola G, Conte G, Mansini LV, Ibarra OH., Nakano H. (Eds), Parallel and Distributed Processing: 15 IPDPSP Workshops Mexico, Lecture Notes in Computer Science, Springer-Verlag, Heidelberg, Germany, 1800:645–652

    Google Scholar 

  21. Dorigo M (1993) Parallel ant system: An experimental study. Unpublished manuscript, (Downloadable from http://iridia.ulb.ac.be/∼mdorigo/ACO/ACO.html)

    Google Scholar 

  22. Talbi EG, Roux O, Fonlupt C, Robillard D (1999) Parallel ant colonies for combinatorial optimization problems. in: Rolim J. et al. (Eds) Parallel and Distributed Processing, 11 IPPS/SPDP’99 Workshops, Lecture Notes in Computer Science, Springer-Verlag, London, UK 1586:239–247

    Google Scholar 

  23. Bolondi M, Bondanza M (1993) Parallelizzazione di un algoritmo per la risoluzione del problema del commesso viaggiatore. Master’s Thesis, Dipartimento di Elettronica e Informazione, Politecnico di Milano: Italy

    Google Scholar 

  24. Michel R, Middendorf M (1998) An island model based ant system with lookahead for the shortest supersquence problem. in: Eiben AE, Back T, Schoenauer H, Schwefel P (Eds), Parallel Problem Solving from the Nature, Lecture Notes in Computer Science, Springer-Verlag, Heidelberg, Germany, 1498:692–701

    Google Scholar 

  25. Delisle P, Krajecki M, Gravel M, Gagné C (2001) Parallel implementation of an ant colony optimization metaheuristic with openmp. Int. Conf. on Parallel Architectures and Compilation Techniques, Proceedings of the 3rd European Workshop on OpenMP (EWOMP’01), Barcelona, Spain

    Google Scholar 

  26. Krüger F, Merkle D, Middendorf M (1998) Studies on a parallel ant system for the BSP model, unpublished manuscript. (Downloadable from http://citeseer.ist.psu.edu/239263.html)

    Google Scholar 

  27. De Jong KA (1975) An Analysis of The Behaviour of a Class of Genetic Adaptive Systems. PhD thesis, University of Michigan

    Google Scholar 

  28. Pham DT, Liu X (1999) Neural Networks for Identification. Prediction and Control, 4th edn, Springer-Verlag

    Google Scholar 

  29. Arifovic J, Gencay R (2001) Using genetic algorithms to select architecture of a feedforward artificial neural network. Physica A, 289:574–594

    Article  MATH  Google Scholar 

  30. Sexton RS, Gupta JND (2000) Comparative evaluation of genetic algorithm and backpropagation for training neural networks. Information Sciences, 129:45–59

    Article  MATH  Google Scholar 

  31. Castillo PA, Merelo JJ, Prieto A, Rivas V, Romero G (2000) G-Prop: Global optimization of multilayer percetptrons using Gas. Neurocomputing, 35:149–163

    Article  MATH  Google Scholar 

  32. Ku KW, Mak MW, Siu WC (1999) Adding learning to cellular genetic algorithms for training recurrent neural networks. IEEE Trans. on Neural Networks, 10(2):239-252

    Article  Google Scholar 

  33. Blanco A, Delgado M, Pegalajar MC (2000) A genetic algorithm to obtain the optimal recurrent neural network. Int. J. Approximate Reasoning, 23:67–83

    Article  MATH  Google Scholar 

  34. Blanco A, Delgado M, Pegalajar MC (2001) A real-coded genetic algorithm for training recurrent neural networks. Neural Networks, 14:93–105

    Article  Google Scholar 

  35. Castillo PA, Gonzalez J, Merelo JJ, Prieto A, Rivas V, Romero G (1999) SA-Prop: Optimization of multilayer perceptron parameters using simulated annealing. Lecture Notes in Computer Science, Springer, 606:661-670

    Article  Google Scholar 

  36. Sexton RS, Alidaee B, Dorsey RE, Johnson JD (1998) Global optimization for artificial neural networks: A tabu search application. European J of Operational Research, 106:570–584

    Article  MATH  Google Scholar 

  37. Battiti R, Tecchiolli G (1995) Training neural nets with the reactive tabu search. IEEE Trans. on Neural Networks, 6(5):1185–1200

    Article  Google Scholar 

  38. Zhang S-B, Liu Z-M (2001) Neural network training using ant algorithm in ATM traffic control. IEEE Int. Symp. on Circuits and Systems (ISCAS 2001) 2:157–160

    Google Scholar 

  39. Blum C, Socha K (2005) Training feed-forward neural networks with ant colony optimization: An application to pattern classification. Fifth Int. Conf. on Hybrid Intelligent Systems

    Google Scholar 

  40. Li J-B, Chung Y-K (2005) A novel back-propagation neural network training algorithm designed by an ant colony optimization. Transmission and Distribution Conference and Exhibition: Asia and Pacific:1–5

    Google Scholar 

  41. Elman JL (1990) Finding structure in time. Cognitive Science, 14:179–211

    Article  Google Scholar 

  42. Liu X (1993) Modelling and Prediction Using Neural Networks. PhD Thesis, University of Wales College of Cardiff, Cardiff, UK.

    Google Scholar 

  43. Pham DT, Karaboga D (1999) Training Elman and Jordan networks for system identification using genetic algorithms. J. of Artificial Intelligence in Engineering 13:107–117

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kalinli, A., Sarikoc, F. (2007). A Parallel Ant Colony Optimization Algorithm Based on Crossover Operation. In: Siarry, P., Michalewicz, Z. (eds) Advances in Metaheuristics for Hard Optimization. Natural Computing Series. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72960-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-72960-0_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-72959-4

  • Online ISBN: 978-3-540-72960-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics