Skip to main content
SpringerLink
Log in

Distributed task allocation in multi-agent environments using cellular learning automata

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

People’s safety is threatened by the repetition of critical events. Many people lose their lives due to unprofessional rescue operation as well as time pressure of the rescue operation. A key problem in urban search and rescue teams, considering the severe turbulence and complexity of the environments which are hit by a crisis, is the coordination between the team members. In order to solve this problem, an effective plan would be the provision of measures where human works with intelligent assistant agents to assign the tasks in any way. Dynamic tasks are identified by the human agent of the rescue team in the crisis environment and are characterized by spatial–temporal characteristics assigned to the appropriate rescue team by the intelligent assistant agents who apply intelligent decision-making techniques. The objective of this study is to propose a new approach for allocating spatial–temporal tasks in multi-agent systems through cellular learning automata as the decision-making technique. Results obtained here indicate that this proposed model can significantly improve the rescue time and space. Rescue teams could cover all critical areas by going through the minimum distance to make maximum use of time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Adams NM, Field M, Gelenbe E, Hand DJ et al (2008) The Aladdin project: intelligent agents for disaster management. In: IARP/EURON workshop on robotics for risky interventions and environmental surveillance

  • Akbari Torkestani J (2012) An adaptive learning automata-based ranking function discovery algorithm. J Intell Inf Syst 39:441–459

    Article  Google Scholar 

  • Ashish N, Eguchi R, Hegde R et al (2007) Situational awareness technologies for disaster response. In: Chen H et al (ed) Terrorism informatics: knowledge management and data mining for homeland security. Springer, Boston, MA, pp 517–544

  • Barzegar S, Davoudpour M, Meybodi MR et al (2011) Formalized learning automata with adaptive fuzzy coloured Petri net; an application specific to managing traffic signals. Sci Iran 18(3):554–565

    Article  Google Scholar 

  • Beigy H, Meybodi MR (2003) A self-organizing channel assignment algorithm: a cellular learning automata approach. Lecture notes in computer science. Springer, Berlin, pp 119–126

    Google Scholar 

  • Beigy H, Meybodi MR (2004) A mathematical framework for cellular learning automata. Adv Complex Syst. doi:10.1142/S0219525904000202

    MathSciNet  MATH  Google Scholar 

  • Beigy H, Meybodi MR (2008) Asynchronous cellular learning automata. Automatica 44(5):1350–1357

    Article  MathSciNet  MATH  Google Scholar 

  • Brutschy A, Pini G (2014) Self-organized task allocation to sequentially interdependent tasks in swarm robotics. Auton Agents Multi Agent Syst 28(1):101–125

    Article  Google Scholar 

  • Campo A, Dorigo M (2007) Efficient multi-foraging in swarm robotics. In: Advances in artificial life, lecture notes in computer science, vol 4648, pp 696–705

  • Castelloh E, Yamamoto T, Nakamura Y, Ishiguro H (2013) Task allocation for a robotic swarm based on an adaptive response threshold model. In: 13th International conference on control, automation and systems. Kimdaejung Convention Center, Gwangju, Korea, pp 259–266

  • Cayrpunar O, Tavl B, Gazi V (2008) Dynamic robot networks for search and rescue operations. In: International workshop on robotics for risky interventions and surveillance of the environment

  • Cornejo A, Dornhaus A et al (2014) Task allocation in ant colonies. Distrib Comput 8784:46–60

    MathSciNet  Google Scholar 

  • Crooks AT, Castle CJE (2012) The integration of agent-based modelling and geographical information for geospatial simulation. In: Agent-based models of geographical systems. Springer, Dordrecht, pp 219–251

  • Dias B (2004) Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamics environments. Ph.D. dissertation, Robotics Institute, Carnegie Mellon University, Pittsburgh

  • Dias B, Stentz A (2000) A free market architecture for distributed control of a multirobot system. In: 6th International conference on intelligent autonomous systems, pp 115–122

  • Dias MB, Zlot R, Kalra N, Stentz A (2006) Market-based multirobot coordination: a survey and analysis. Proc IEEE 94:1257–1270

    Article  Google Scholar 

  • Dorigo M (2005) SWARM-BOT: an experiment in swarm robotics. In: Arabshahi P, Martinoli A (eds) 2005 IEEE swarm intelligence symposium, pp 192–200

  • Dorigo M, Floreano D, Gambardella LM, Mondada F, Nolfi S, Baaboura T et al (2013) A novel concept for the study of heterogeneous robotic swarms. IEEE Robot Autom Mag 20(4):60–71

    Article  Google Scholar 

  • Dos Santos F, Bazzan ALC (2011) Towards efficient multiagent task allocation in the robocup rescue a biologically-inspired approach. Auton Agents Multi Agent Syst 22:465–486

    Article  Google Scholar 

  • Esnaashari M, Meybodi MR (2008) A cellular learning automata based clustering algorithm for wireless sensor networks. Sens Lett 6:723–735

    Article  Google Scholar 

  • Esnaashari M, Meybodi MR (2010) Dynamic point coverage problem in wireless sensor networks: a cellular learning automata approach. Ad Hoc Sens Wirel Netw 10:193–234

    MATH  Google Scholar 

  • Fasli M, Michalakopoulos M (2006) Developing software agents using.NET. University of Essex Department of Computer Science, Colchester

    Google Scholar 

  • Fathy Navid AH, Aghababa AB (2013) Cellular learning automata and its applications. In: Computer and information science, numerical analysis and scientific computing. Publish with INTECH. doi:10.5772/52953

  • Fayyoumi E, Oommen BJ (2009) Achieving micro aggregation for secure statistical databases using fixed structure partitioning based learning automata. IEEE Trans Syst Man Cybern B Cybern 39(5):1192–1205

    Article  Google Scholar 

  • Ferreira PR, Boffo FS, Bazzan ALC (2008) Using swarm-GAP for distributed task allocation in complex scenarios. Massively multi-agent technology, LNCS, vol 5043, pp 107–121

  • Ferreira PR Jr, Dos Santos F, Bazzan ALC, Epstein D, Waskow SJ (2009) RoboCup rescue as multi agent task allocation among teams: experiments with task interdependencies. Auton Agents Multi Agent Syst 20(3):421–443

    Article  Google Scholar 

  • Gerkey BP, Mataric MJ (2003) Multi-robot task allocation: analyzing the complexity and optimality of key architectures. In: IEEE international conference on robotics and automation. doi:10.1109/ROBOT.2003.1242189

  • Gerkey BP, Mataric MJ (2004) A formal analysis and taxonomy of task allocation in multi-robot systems. Int J Robot Res 23(9):939–954

    Article  Google Scholar 

  • Godoy J, Gini M (2013) Task allocation for spatially and temporally distributed tasks. In: Proceedings of the 12th international conference IAS-12, AISC 194. Springer, Berlin, Heidelberg, pp 603–612

  • Grinshpoun T, Grubshtein A et al (2013) Asymmetric distributed constraint optimization problems. J Artif Intell Res 47:613–647

    Article  MathSciNet  MATH  Google Scholar 

  • Ham M, Agha G (2007) Market-based coordination strategies for large-scale multi-agent systems. Syst Inf Sci Notes 2(1):126–131

    Google Scholar 

  • Ham M, Agha G (2008) A study of coordinated dynamic market-based task assignment in massively multi-agent systems. In: Massively multiagent technology, lecture notes in computer science, vol 5043, pp 43–63

  • Hunsberger L, Grosz BJ (2000) A combinatorial auction for collaborative planning. In: Proceedings of the fourth international conference on multiagent systems, ICMAS, pp 151–158

  • Hussein A, Khamis A (2013) Market-based approach to multi-robot task allocation. In: International conference on individual and collective behaviors in robotics, pp 69–74

  • Ikemoto Y, Miura T, Asama H (2010) Adaptive division-of-labor control algorithm for multi-robot systems. J Robot Mechatron 22(4):514–525

    Article  Google Scholar 

  • Jain S, McLean CR (2004) An architecture for modeling and simulation of emergency response. In: Proceedings of the 2004 IIE conference

  • Jinguo L, Yuechao W, Bin L, Shugen M (2007) Current research, key performances and future development of search and rescue robots. Front Mech Eng China 2:404–416

    Article  Google Scholar 

  • Kalra N, Martinoli A (2006) Comparative study of market-based and threshold-based task allocation. Distrib Auton Robot Syst 7:91–101

    MATH  Google Scholar 

  • Khalil KM, Abdel-Aziz MH, Nazmy MT, Salem AM (2008) The role of artificial intelligence technologies in crisis response. In: Mendel conference, 14th international conference on soft computing

  • Khalil KM, Abdel-Aziz MH, Nazmy MT, Salem AM (2009) Multi-agent crisis response systems—design requirements and analysis of current systems. In: Fourth international conference on intelligent computing and information systems. Egypt, Cairo, pp 920–925

  • Koes M, Nourbakhsh I, Sycara K (2005) Heterogeneo multirobot coordination with spatial and temporal constraints. In: Proceedings of the twentieth national conference on artificial intelligence (AAAI), pp 1292–1297

  • Labella TH, Dorigo M, Deneubourg JL (2006) Division of labor in a group of robots inspired by ants’ foraging behavior. ACM Trans Auton Adapt Syst 1(1):4–25

    Article  Google Scholar 

  • Lakshmivarahan S (1981) Learning algorithms: theory and applications. Springer, Berlin

    Book  MATH  Google Scholar 

  • Law M, Collins A (2013) Getting to know ArcGIS for desktop. Environmental Systems Research Institute, Redlands, pp 19–30

    Google Scholar 

  • Leite AR, Enembreck F, Barthès JA (2014) Distributed constraint optimization problems: review and perspectives. Expert Syst Appl 41:5139–5157

    Article  Google Scholar 

  • Liekna A, Lavendelis E, Grabovskis A (2012) Experimental analysis of contract net protocol in multi-robot task allocation. Appl Comput Syst 13(1):6–14

    Article  Google Scholar 

  • Liu W, Winfield A, Sa J, Chen J, Dou L (2007) Towards energy optimization: emergent task allocation in a swarm of foraging robots. Adapt Behav 15(3):289–305

    Article  Google Scholar 

  • Maheswaran RT, Rogers CM, Sanchez R, Szekely P (2010) Human-agent collaborative optimization of real-time distributed dynamic multi-agent coordination. In: 9th International conference on autonomous agents and multi-agent systems. Canada, Toronto, pp 49–56

  • Massaguer D, Balasubramanian V, Mehrotra S, Venkatasubramanian N (2006) MultiAgent simulation of disaster response. In: ATDM workshop in AAMAS, Japan

  • Meybodi MR, Kharazmi MR (2004) Application of cellular learning automata to image processing. J Amirkabir 14(56):1101–1126

    Google Scholar 

  • Misra S, Oommen BJ (2009) Using pursuit automata for estimating stable shortest paths in stochastic network environments. Int J Commun Syst 22(4):441–468

    Article  Google Scholar 

  • Misra S, Abraham KI, Obaidat MS, Krishna PV (2009) LAID: a learning automata-based scheme for intrusion detection in wireless sensor networks. Secur Commun Netw 2(2):105–115

    Article  Google Scholar 

  • Moghiss V, Meybodi MR, Esnaashari M (2010) An intelligent protocol to channel assignment in wireless sensor networks: learning automata approach. In: International conference on information networking and automation, pp V1-338–V1-343

  • Murakami Y, Minami K, Kawasoe T, Ishida T (2002) Multi-agent simulation for crisis management. In: IEEE workshop on knowledge media networking

  • Najim K, Poznyak AS (1994) Learning automata: theory and applications. Pergamon, Oxford

    MATH  Google Scholar 

  • Narendra KS, Thathachar MAL (1989) Learning automata: an introduction. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Neumann JV (1996) The theory of self-reproducing automata. In: Burks AW (ed) The theory of self-reproducing automata. University of Illinois Press, Urbana, London

  • Nourjou R, Hatayama M (2011) Intelligent GIS for spatial cooperation of earthquake emergency response. Ann Disaster Prev Res Inst Kyoto Univ 54(B):29–34

    Google Scholar 

  • Nourjou R, Hatayama M, Tatano H (2011) Introduction to spatially distributed intelligent assistant agents for coordination of human-agent teams’ actions. In: Proceedings of the 2011 IEEE international symposium on safety, security and rescue robotics, Kyoto, Japan, pp 251–258

  • Nourjou R, Smith SF, Hatayama M, Szekely P (2014a) Intelligent algorithm for assignment of agents to human strategy in centralized multi-agent coordination. J Softw 9(10):2586–2597

    Article  Google Scholar 

  • Nourjou R, Szekely P, Hatayama M, Ghafory-Ashtiany M, Smith SF (2014b) Data model of the strategic action planning and scheduling problem in a disaster response team. J Disaster Res 9(3):381–399

    Article  Google Scholar 

  • Nourjou R, Hatayama M, Smith SF, Sadeghi A, Szekely P (2014c) Design of a GIS-based assistant software agent for the incident commander to coordinate emergency response operations. In Workshop on robots and sensors integration in future rescue information system

  • Parker LE (2008) Multiple mobile robot systems. In: Springer handbook of robotics. Springer, pp 921–941

  • Parks A (2011) Using the open source DotSpatial GIS library to create tasks for the data for environmental modeling (D4EM) system. Research Triangle Institute International, North Carolina

    Google Scholar 

  • Quiñonez Y, De lope J, Maravall D (2011a) Bio-inspired decentralized self-coordination algorithms. In: 4th International work-conference on the interplay between natural and artificial computation, IWINAC, La Palma, Canary Islands, Spain. Springer, Berlin, Heidelberg, pp 30–39

  • Quiñonez Y, Maravall D, De lope J (2011b) Stochastic learning automata for self-coordination in heterogeneous multi-tasks selection in multi-robot systems. In: 10th Mexican international conference on artificial intelligence, MICAI 2011, Puebla, Mexico. Springer, Berlin, Heidelberg, pp 443–453

  • Rahwan T, Jennings NR (2007) An algorithm for distributing coalitional value calculations among cooperating agents. Artif Intell J 171:535–567

    Article  MathSciNet  MATH  Google Scholar 

  • Rasekh A, Vafaeinezhad AR (2012) Developing a GIS based decision support system for resource allocation in earthquake search and rescue operation. In: ICCSA 2012, part II, LNCS 7334. Springer, Berlin, Heidelberg, pp 275–285

  • Russell S, Norvig P (1995) Artficial intelligence: a modern approach. Prentice-Hall, Saddle River

    MATH  Google Scholar 

  • Scerri P, Farinelli A, Okamoto S, Tambe M (2005) Allocating tasks in extreme teams. In: Proceedings of the fourth international joint conference on autonomous agents and multiagent systems, pp 727–734

  • Schiff JL (2008) Cellular learning automata: a discrete view of the world. Wiley, Chichester

    MATH  Google Scholar 

  • Schoenharl T, Madey G et al (2006) WIPER: a multi-agent system for emergency response. In: Proceedings of the 3rd international ISCRAM conference, Newark, NJ, USA

  • Schurr N, Marecki J, Lewis JP, Tambe M, Scerri P (2009) The DEFACTO system: coordinating human-agent teams for the future of disaster response. Published Articles of CREATE Research Archive

  • Shiroma P, Campos M (2009) CoMutaR: a framework for multi-robot coordination and task allocation. In: IEEE/RSJ international conference on intelligent robots and systems, pp 4817–4824

  • Smith RG (1980) The contract net protocol: high-level communication and control in a distributed problem solver. IEEE Trans Comput C–29(12):1104–1113

    Article  Google Scholar 

  • Song T, Yan X, Liang A, Chen K, Guan H (2009) A distributed bidirectional auction algorithm for multirobot coordination. In: IEEE international conference on research challenges in computer science, pp 145–148

  • Suarez Baron SA (2010) Dynamic task allocation and coordination in cooperative multi-agent environment. Doctoral Thesis of Programming in Technology, Dissertation, University of Girona

  • Talabeigi M, Forsati R, Meybodi MR (2010) A hybrid web recommender system based on cellular learning automata. In: IEEE international conference on granular computing, San Jose, California, pp 453–458

  • Testlin ML (1961) On the behavior of finite automata in randim media. Autom Remote Control 22(10):1210–1219

  • Theraulaz G, Bonabeau E, Deneubourg J (1998) Response threshold reinforcement and division of labour in insect societies. R Soc Lond Ser B Biol Sci 265:327–332

  • Vafaeinezhad AR, Alesheikh AA, Hamrah M, Nourjou R, Shad R (2009) Using GIS to develop an efficient spatio-temporal task allocation algorithm to human groups in an entirely dynamic environment case study: earthquake rescue teams. In: Computational science and its applications—lecture notes in computer science, vol 5592, pp 66–78

  • Yan Z, Jouandeau N, Cherif AA (2013) A survey and analysis of multi-robot coordination. Int J Adv Robot Syst 10:399

    Article  Google Scholar 

  • Yang Y, Zhou C, Tian Y (2009) Swarm robots task allocation based on response threshold model. In: IEEE international conference on autonomous robots and agents, pp 171–176

  • Yasuda T, Kage K, Ohkura K (2014) Response threshold-based task allocation in a reinforcement learning robotic swarm. In: IEEE 7th International workshop on computational intelligence and applications, Hiroshima, Japan, pp 189–194

Download references

Author information

Authors and Affiliations

  1. Department of Computing, Macquarie University, North Ryde, NSW, 2109, Sydney, Australia

    Maryam Khani

  2. Department of Computer Engineering, K.N. Toosi University of Technology, Tehran, Iran

    Ali Ahmadi

  3. Department of Computer Science and Research Branch, Islamic Azad University, Tehran, Iran

    Hajar Hajary

Authors
  1. Maryam Khani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Ahmadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hajar Hajary
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maryam Khani.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khani, M., Ahmadi, A. & Hajary, H. Distributed task allocation in multi-agent environments using cellular learning automata. Soft Comput 23, 1199–1218 (2019). https://doi.org/10.1007/s00500-017-2839-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2839-5

Keywords

Search

Navigation