Abstract
Stochastic diffusion search (SDS) is a global Swarm Intelligence optimisation technique based on the behaviour of ants, rooted in the partial evaluation of an objective function and direct communication between agents. Although population based decision mechanisms employed by many Swarm Intelligence methods can suffer poor convergence resulting in ill-defined halting criteria and loss of the best solution, as a result of its resource allocation mechanism, the solutions found by Stochastic Diffusion Search enjoy excellent stability.
Previous implementations of SDS have deployed stopping criteria derived from global properties of the agent population; this paper examines new local SDS halting criteria and compares their performance with ‘quorum sensing’ (a termination criterion naturally deployed by some species of tandem-running ants). In this chapter we discuss two experiments investigating the robustness and efficiency of the new local termination criteria; our results demonstrate these to be (a) effectively as robust as the classical SDS termination criteria and (b) almost three times faster.
This paper offers extended discussion of results first presented at ICCCI 2016 (Halkidiki) and published in the conference proceedings [11].
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The simplifying assumption is that, by considering only the mean transition of agents between different clusters of agents, rather than the full probability distribution (as investigated in [51]), a sufficiently accurate model of SDS may be obtained.
- 2.
It should be emphasised that this analogy is provided simply to illustrate the communication and feedback mechanisms at the heart of a stochastic diffusion search, and not as a heuristic to be employed by a group of hungry conference delegates.
- 3.
- 4.
Thus multiple testing is very similar to the repeated metrics strategy deployed by real scouts in nest selection, albeit in the latter case scouts assess potential nest sites across a number of metrics using a weighted additive strategy [27].
- 5.
Standard SDS has previously been shown to be a global search algorithm [51] - it will eventually converge to the global best solution in a given search space; by removing agents form the swarm, relative to standard SDS the number of potential agents remaining available for explore-exploit behaviour is reduced.
- 6.
To facilitate the use of homogenous performance metrics, we assume that in a population of k agents, k single asynchronous updates corresponds to one standard synchronous iteration cycle.
- 7.
\(\beta \) defines a “uniform random noise” hypothesis; an aggregate of all the possible hypotheses an agent could have other than the putative solution hypothesis.
- 8.
These parameters define a problem analogous to the search space being infinitely large, wherein the only way an agent can adopt the ‘best’ solution is to receive it via diffusion from an active agent.
References
Aleksander, I., Stonham, T.J.: Guide to pattern recognition using random access memories. Comput. Digit. Tech. 2(1), 29–40 (1979)
Al-Rifaie, M.M., Bishop, J.M.: Stochastic diffusion search review. J. Behav. Robot. 4(3), 155–173 (2013)
Anoop, K., Sumana, A.: Response to a change in the target nest during ant relocation. J. Exp. Biol. 218(6), 887–92 (2015)
Arthur, W.B.: Inductive reasoning and bounded rationality (The El Farol Problem). Amer. Econ. Rev. 84, 406–411 (1994)
Back, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press, Oxford (1996)
Beattie, P.D., Bishop, J.M.: Self-localisation in the ‘SENARIO’ autonomous wheelchair. J. Intell. Robot. Syst. 22, 255–267 (1998)
Bishop, J.M.: Stochastic Searching Networks. In: Proceedings of 1st IEE International Conference on Artificial Neural Networks. IEE Conference Publication (313), pp. 329–331. IEE, London (1989)
Bishop, J.M.: Anarchic techniques for pattern classification. Ph.D. thesis, Reading University, UK (1989)
Bishop, J.M., Torr, P.H.S.: The stochastic search network. In: Linggard, R., Myers, D.J., Nightingale, C. (eds.) Neural Networks for Images, Speech and Natural Language. Chapman Hall, New York (1992)
Bishop, J.M., Nasuto, S.J., De Meyer, K.: Dynamic knowledge representation in connectionist systems. In: Dorronsoro, J.R. (ed.) Artificial Neural Networks ICANN. LNCS, vol. 2415, pp. 308–313. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-46084-5_51
Bishop, J.M., Andrew, O.M., Robinson, E.J.H.: Local termination criteria for stochastic diffusion search: a comparison with the behaviour of ant nest-site selection. In: Nguyen, N., Iliadis, L., Yannis, M., Bogdan, T. (eds.) Computational Collective Intelligence. Lecture Notes in Computer Science, vol. 9875, pp. 474–486. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-319-45243-2_44
Bonabeau, E., Dorigo, M., Theraulaz, G.: Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, Oxford (1999)
Bonabeau, E., Dorigo, M., Theraulaz, G.: Inspiration for optimisation from social insect behaviour. Nature 406, 3942 (2000)
Cao, T.T.: High social density increases foraging and scouting rates and induces polydomy in Temnothorax ants. Behav. Ecol. Sociobiol. 67(11), 1799–1807 (2013)
Carroll, C.R., Janzen, D.H.: Ecology of foraging by ants. Annu. Rev. Ecol. Syst. 4, 231–257 (1973)
Chadab, R., Rettenmeyer, C.: Mass recruitment by army ants. Science 188, 1124–1125 (1975)
Deneubourg, J.L., Pasteels, J.M., Verhaeghe, J.C.: Probabilistic behaviour in ants: a strategy of errors? J. Theor. Biol. 105(2), 259–271 (1983)
Dornhaus, A., Franks, N.R., Hawkins, R.M., Shere, H.N.S.: Ants move to improve: colonies of Leptothorax albipennis emigrate whenever they find a superior nest site. Anim. Behav. 67(5), 959–963 (2004)
Dornhaus, A., Holley, J.A., Pook, V.G., Worswick, G., Franks, N.R.: Why do not all workers work? Colony size and workload during emigrations in the ant Temnothorax albipennis. Behav. Ecol. Sociobiol. 63(1), 43–51 (2008)
Dorigo, M., Maniezzo, V., Colorni, A.: Positive feedback as a search strategy, Dipartimento di Elettronica e Informatica, Politecnico di (1991)
Dorigo, M.: Optimisation, learning and natural algorithms. Politecnico di Italy, Milano (1992)
Dorigo, M., Caro, G.D., Gambardella, L.M.: Ant algorithms for discrete optimisation. Artif. Life 5(2), 137–172 (1999)
Franklin, E.L.: The journey of tandem running: the twists, turns and what we have learned. Insectes Sociaux 61, 1–8 (2014)
Franks, N.R., Dornhaus, A., Metherell, B., Nelson, T., Lanfear, S.A., Symes, W.: Not everything that counts can be counted: ants use multiple metrics for a single nest trait. Proc. R. Soc. Lond. Ser. B 273, 165–169 (2006)
Franks, N.R., Hooper, J.W., Dornhaus, A., Aukett, P.J., Hayward, A.L., Berghoff, S.M.: Reconnaissance and latent learning in ants. Proc. R. Soc. Lond. Ser. B 274(1617), 1505–1509 (2007)
Franks, N.R., et al.: Moving targets: collective decisions and flexible choices in house-hunting ants. Swarm Intell. 1(2), 81–94 (2007)
Franks, N.R., Mallon, E.B., Bray, H.E., Hamilton, M.J., Mischler, T.C.: Strategies for choosing between alternatives with different attributes: exemplified by house-hunting ants. Anim. Behav. 65, 215–223 (2003)
Frank, N.R., et al.: How ants use quorum sensing to estimate the average quality of a fluctuating resource. Sci. Rep. 5, 11890 (2015)
Goldberg, D.: Genetic Algorithms in Search, Optimisation and Machine Learning. Addison Wesley, Reading (1989)
Goodman, L.J., Fisher, R.C.: The Behaviour and Physiology of Bees. CAB International, Oxon (1991)
Grech-Cini, E.: Locating facial features. Ph.D. dissertation, University of Reading, Reading UK (1995)
Holldobler, B., Wilson, E.O.: The Ants. Springer, Heidelberg (1990)
Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor (1975)
Fan, H., Hua, Z., Li, J.J., Yuan, D.: Solving a shortest path problem by ant algorithm. In: Proceedings of 2004 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3174–3177 (2004)
Krieger, M.J., Billeter, J.B., Keller, L.: Ant-like task allocation and recruitment in cooperative robots. Nature 406(6799), 992–995 (2000)
Iosifescu, M.: Finite Markov Processes and Their Applications. Wiley, Chichester (1980)
Kennedy, J., Eberhart, R.C., Shi, Y.: Swarm Intelligence. Morgan Kauffman, San Francisco (2001)
Kennedy, J., Eberhart, R.C.: Particle swarm optimisation. In: Proceedings of the IEEE International Conference on Neural Networks IV, pp. 1942–1948 (1995)
Kramer, B.H., Scharf, I., Foitzik, S.: The role of per-capita productivity in the evolution of small colony sizes in ants. Behav. Ecol. Sociobiol. 68(1), 41–53 (2013)
De Meyer, K.: Explorations in stochastic diffusion search: soft and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Technical report KDM/JMB/2000-1. University of Reading, Reading UK (2000)
De Meyer, K., Bishop, J.M., Nasuto, S.J.: Small world network behaviour of stochastic diffusion search. In: Dorronsoro, J.R. (ed.) Artificial Neural Networks, ICANN, Madrid. LNCS, vol. 2415, pp. 147–152. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-46084-5_25
De Meyer, K., Nasuto, S.J., Bishop, J.M.: Stochastic diffusion optimisation: the application of partial function evaluation and stochastic recruitment. In: Abraham, A., Grosam, C., Ramos, V. (eds.) Stigmergic Optimisation. SCI, vol. 31, pp. 185–207. Springer, Heidelberg (2006). https://doi.org/10.1007/978-3-540-34690-6_8
Kurvers, R.H.J.M., Wolf, M., Krause, J.: Humans use social information to adjust their quorum thresholds adaptively in a simulated predator detection experiment. Behav. Ecol. Sociobiol. 68(3), 449–456 (2014)
Miller, M.B., Bassler, B.L.: Quorum sensing in bacteria. Annu. Rev. Microbiol. 55(1), 165–199 (2001)
Mitrus, S.: The cavity-nest ant Temnothorax crassispinus prefers larger nests. Insectes Sociaux 62(1), 43–49 (2015)
Moglich, M., Maschwitz, U., Holldobler, B.: Tandem calling: a new kind of signal in ant communication. Science 186(4168), 1046–1047 (1974)
Mugford, S.T., Mallon, E.B., Franks, N.R.: The accuracy of Buffon’s needle: a rule of thumb used by ants to estimate area. Behav. Ecol. 12, 655–658 (2001)
Myatt, D.M., Bishop, J.M., Nasuto, S.J.: Minimum stable convergence criteria for stochastic diffusion search. Electron. Lett. 22(40), 112–113 (2004)
Myatt, D., M., Nasuto, S.J., Bishop J.M., : Alternative recruitment strategies for SDS. In: Proceedings of AISB06: Symposium on Exploration vs. Exploitation in Naturally Inspired Search, Bristol, UK, pp. 181–187 (2006)
Nasuto, S.J.: Analysis of resource allocation of stochastic diffusion search. Ph.D. dissertation. University of Reading, Reading UK (1999)
Nasuto, S.J., Bishop, J.M.: Convergence of the stochastic diffusion search. Parallel Algorithms Appl. 14, 89–107 (1999)
Nasuto, S.J., Bishop, J.M., Lauria, S.: Time complexity of stochastic diffusion search. In: Heiss, M. (ed) Proceedings of International ICSC/IFAC Symposium on Neural Computation, Vienna (1998)
Nasuto, S.J., Dautenhahn, K., Bishop, J.M.: Communication as an emergent metaphor for neuronal operation. In: Nehaniv, C. (ed.) Computation for Metaphors, Analogy, and Agents. LNCS, vol. 1562, pp. 365–379. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48834-0_19
Nasuto, S.J., Bishop, J.M., De Meyer, K.: Communicating neurons: a connectionist spiking neuron implementation of stochastic diffusion search. Neurocomputing 72(4–6), 704–712 (2008)
Nasuto, S.J., Bishop, J.M.: Steady state resource allocation analysis of the stochastic diffusion search. Biol. Inspired Cogn. Arch. 12, 65–76 (2015)
Neumaier, A.: Complete search in continuous global optimisation and constraint satisfaction. In: Isereles, A. (ed.) Acta Numerica 2004. Cambridge University Press, Cambridge UK (2004)
Pratt, S.C.: Behavioural mechanisms of collective nest-site choice by the ant Temnothorax curvispinosus. Insectes Sociaux 52, 383–392 (2005)
Pratt, S.C.: Quorum sensing by encounter rates in the ant Temnothorax albipennis. Behav. Ecol. 16, 488–496 (2005)
Pratt, S.C., Mallon, E.B., Sumpter, D.J.T., Franks, N.R.: Quorum sensing, recruitment, and collective decision-making during colony emigration by the ant Leptothorax albipennis. Behav. Ecol. Sociobiol. 52(2), 117–127 (2002)
Pratt, S.C., Pierce, N.E.: The cavity-dwelling ant Leptothorax curvispinosus uses nest geometry to discriminate among potential homes. Anim. Behav. 62, 281–287 (2001)
Pratt, S.C., Sumpter, D.J.T., Mallon, E.B., Franks, N.R.: An agent-based model of collective nest site choice by the ant Temnothorax albipennis. Anim. Behav. 70, 1023–1036 (2005)
Robinson, E.J.H., Feinerman, O., Franks, N.R.: How collective comparisons emerge without individual comparisons of the options. Proc. Royal Soc. B 281, 20140737 (2014). https://doi.org/10.1098/rspb.2014.0737
Robinson, E.J.H., Franks, N.R., Ellis, S., Okuda, S., Marshall, J.A.R.: A simple threshold rule is sufficient to explain sophisticated collective decision-making. PLoS One 6, e19981 (2011)
Robinson, E.J.H., Smith, F.D., Sullivan, K.M.E., Franks, N.R.: Do ants make direct comparisons? Proc. Royal Soc. B 276, 2635–2641 (2009)
Sasaki, T., Colling, B., Sonnenschein, A., Boggess, M.M., Pratt, S.C.: Flexibility of collective decision making during house hunting in Temnothorax ants. Behav. Ecol. Sociobiol. 69, 707–714 (2015)
Sasaki, T., Pratt, S.C.: Emergence of group rationality from irrational individuals. Behav. Ecol. 22(2), 276–281 (2011)
Seeley, T.D.: The Wisdom of the Hive. Harvard University Press, Cambridge (1995)
Seeley, T.D., Visscher, P.K.: Quorum sensing during nest-site selection by honeybee swarms. Behav. Ecol. Sociobiol. 56, 594–601 (2004)
Seeley, T.D., Visscher, P.K., Schlegel, T., Hogan, P.M., Franks, N.R., Marshall, J.A.R.: Stop signals provide cross inhibition in collective decision-making by honey bee swarms. Science 335, 108–111 (2012)
Stroeymeyt, N., Robinson, E.J.H., Hogan, P.M., Marshall, J.A.R., Giurfa, M., Franks, N.R.: Experience-dependent flexibility in collective decision-making by house-hunting ants. Behav. Ecol. 22(3), 535–542 (2011)
Sueur, C., Deneubourg, J.L., Petit, O.: Sequence of quorums during collective decision making in macaques. Behav. Ecol. Sociobiol. 64, 1875–1885 (2010)
Sumpter, D.J.T., Pratt, S.C.: Quorum responses and consensus decision making. Proc. R. Soc. B 364(1518), 743–753 (2009)
Ward, A.J.W., Sumpter, D.J.T., Couzin, I.D., Hart, P.J.B., Krause, J.: Quorum decision-making facilitates information transfer in fish shoals. Proc. Nat. Acad. Sci. 105(19), 6948–6953 (2008)
Whitaker, R.M., Hurley, S.: An agent based approach to site selection for wireless networks. In: Proceedings of 2002 ACM Symposium on Applied Computing (Madrid), pp. 574–577. ACM, New York (2002)
Wilson, E.O.: Communication by tandem running in the ant genus Cardiocondyla. Psyche 66(3), 29–34 (1959)
Wilson, E.O.: Chemical communication among workers of the fire ant Solenopsis saevissima (Fr. Smith) 1. The organisation of mass-foraging. Anim. Behav. 10, 134–147 (1962)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer-Verlag GmbH Germany, part of Springer Nature
About this chapter
Cite this chapter
Martin, A.O., Bishop, J.M., Robinson, E.J.H., Myatt, D.R. (2019). Local Termination Criteria for Swarm Intelligence: A Comparison Between Local Stochastic Diffusion Search and Ant Nest-Site Selection. In: Nguyen, N., Kowalczyk, R., Hernes, M. (eds) Transactions on Computational Collective Intelligence XXXII. Lecture Notes in Computer Science(), vol 11370. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-58611-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-662-58611-2_3
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-58610-5
Online ISBN: 978-3-662-58611-2
eBook Packages: Computer ScienceComputer Science (R0)