Skip to main content
SpringerLink
Log in

Emergence of divisional cooperation with negotiation and re-learning and evaluation of flexibility in continuous cooperative patrol problem

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

We propose a learning and negotiation method to enhance divisional cooperation and demonstrate its flexibility for adapting to environmental changes in the context of the multi-agent cooperative problem. We now have access to a vast array of information, and everything has become more closely connected. However, this makes tasks/problems in these environments complicated. In particular, we often require fast decision-making and flexible responses to follow environmental changes. For these requirements, multi-agent systems have been attracting interest, but the manner in which multiple agents cooperate is a challenging issue because of the computational cost, environmental complexity, and sophisticated interaction between agents. In this work, we address the continuous cooperative patrol problem, which requires cooperation based on high autonomy, and propose an autonomous learning method with simple negotiation to enhance divisional cooperation for efficient work. We also investigate how this method can have high flexibility to adapt to change. We experimentally show that agents with our method generate several types of role sharing in a bottom-up manner for effective and flexible divisional cooperation. The results also show that agents using our method appropriately change their roles in different environmental change scenarios and enhance the overall efficiency and flexibility.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Ahmadi M, Stone P (2006) A multi-robot system for continuous area sweeping tasks, In: Proceedings of the 2006 IEEE international conference on robotics and automation. pp 1724–1729

  2. Cheng K, Dasgupta P (2007) Dynamic area coverage using faulty multi-agent swarms. In: IEEE/WIC/ACM international conference on intelligent agent technology, 2007. IAT 07, pp 17 –23

  3. Elor Y, Bruckstein AM (2009) Multi-a(ge)nt graph patrolling and partitioning. In: Proceedings of the 2009 IEEE/WIC/ACM international joint conference on web intelligence and intelligent agent technologies. pp 52–57

  4. Ghavami SM, Taleai M, Arentze T (2017) An intelligent spatial land use planning support system using socially rational agents. Int J Geogr Inf Sci 31(5):1022–1041. https://doi.org/10.1080/13658816.2016.1263306

    Article  Google Scholar 

  5. Jones C, Matarić MJ (2003) Adaptive division of labor in large-scale minimalist multi-robot systems. In: Proceedings of the 2003 IEEE/RSJ international conference on intelligent robots and systems (IROS 2003) vol 2. pp 969–1974

  6. Jordán J, Torreño A, de Weerdt M, Onaindia E (2017) A better-response strategy for self-interested planning agents. Appl Intell 48:1020–1040

    Article  Google Scholar 

  7. Kato C, Sugawara (2013) Decentralized area partitioning for a cooperative cleaning task. In: Boella G, Elkind E, Savarimuthu B, Dignum F and Purvis M (eds), PRIMA 2013: principles and practice of multi-agent systems. Lecture notes in computer science , vol 8291. Springer Berlin Heidelberg, pp 470–477

  8. Li T, la Prieta Pintado FD, Corchado JM, Bajo J (2017) Multi-source homogeneous data clustering for multi-target detection from cluttered background with misdetection. Appl Soft Comput 60:436–446

    Article  Google Scholar 

  9. Menezes T, Tedesco P, Ramalho G (2006) Negotiator agents for the patrolling task. In: Sichman JS, Coelho H, Rezende SO (eds) Proceedings of advances in artificial intelligence-IBERAMIA-SBIA 2006: 2nd International Joint Conference, 10th Ibero-American Conference on AI, 18th Brazilian AI Symposium, Ribeirão Preto, Brazil, October 23–27, 2006. Springer, Berlin, Heidelberg, pp 48–57

  10. Othmani-Guibourg M, Fallah-Seghrouchni AE, Farges JL Potop-Butucaru M (2017) Multi-agent patrolling in dynamic environments. In: 2017 IEEE international conference on agents (ICA). pp 72–77

  11. Pasqualetti F, Durham JW, Bullo F (2012) Cooperative patrolling via weighted tours: performance analysis and distributed algorithms. IEEE Trans Robot 28(5):1181–1188

    Article  Google Scholar 

  12. Popescu MI, Rivano H, Simonin O (2016) Multi-robot patrolling in wireless sensor networks using bounded cycle coverage, In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). pp 169–176

  13. Portugal D, Rocha R (2011) A survey on multi-robot patrolling algorithms. In: Camarinha-Matos LM (ed) Proceedings of technological innovation for sustainability: second IFIP WG 5.5/SOCOLNET doctoral conference on computing, electrical and industrial systems, DoCEIS 2011, Costa de Caparica, Portugal, February 21–23, 2011. Springer, Berlin, Heidelberg, pp 139–146

  14. Sampaio P, Ramalho G, Tedesco P (2010) The gravitational strategy for the timed patrolling. In: 2010 22nd IEEE international conference on tools with artificial intelligence (ICTAI). pp 113–120

  15. Smith A (1776) An inquiry into the nature and causes of the wealth of nations, number smith1776 In: History of economic thought books. McMaster University archive for the history of economic thought. https://ideas.repec.org/b/hay/hetboo/smith1776.html. Accessed 22 Dec 2017

  16. Sugiyama A, Sea V, Sugawara T (2016) Effective task allocation by enhancing divisional cooperation in multi-agent continuous patrolling tasks, In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). pp 33–40

  17. Sugiyama A, Sugawara T (2015) Meta-strategy for cooperative tasks with learning of environments in multi-agent continuous tasks In: Proceedings of the 30th annual ACM symposium on applied computing. pp 494–500

  18. Sugiyama A, Sugawara T (2017) Improvement of robustness to environmental changes by autonomous divisional cooperation in multi-agent cooperative patrol problem. In: Demazeau Y, Davidsson P, Bajo J, Vale Z (eds) Advances in practical applications of cyber-physical multi-agent systems: the paams collection. Springer, Cham, pp 259–271

    Chapter  Google Scholar 

  19. Suseki K, Mizuguchi T, Sugawara K, Kosuge K (2005) Proportion regulation for division of labor in multi-robot system, In: Proceedings of the 2005 IEEE/RSJ international conference on intelligent robots and systems. pp 2339–2344

  20. Yoneda K, Sugiyama A, Kato C, Sugawara T (2015) Learning and relearning of target decision strategies in continuous coordinated cleaning tasks with shallow coordination. Web Intell 13(4):279–294

    Article  Google Scholar 

Download references

Acknowledgements

This work was partly supported by JSPS KAKENHI Grant No. 17KT0044 and Grant-in-Aid for JSPS Research Fellow (JP16J11980).

Author information

Authors and Affiliations

  1. Department Computer Science and Communications Engineering, Waseda University, Tokyo, 1698555, Japan

    Ayumi Sugiyama, Vourchteang Sea & Toshiharu Sugawara

Authors
  1. Ayumi Sugiyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vourchteang Sea
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Toshiharu Sugawara
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ayumi Sugiyama.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sugiyama, A., Sea, V. & Sugawara, T. Emergence of divisional cooperation with negotiation and re-learning and evaluation of flexibility in continuous cooperative patrol problem. Knowl Inf Syst 60, 1587–1609 (2019). https://doi.org/10.1007/s10115-018-1285-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-018-1285-8

Keywords

Search

Navigation