Skip to main content

A Reinforcement Learning Based Method for Optimizing the Process of Decision Making in Fire Brigade Agents

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7026))

Abstract

Decision making in complex, multi agent and dynamic environments such as disaster spaces is a challenging problem in Artificial Intelligence. Uncertainty, noisy input data and stochastic behavior which are common characteristics of such environment makes real time decision making more complicated. In this paper an approach to solve the bottleneck of dynamicity and variety of conditions in such situations based on reinforcement learning is presented. This method is applied to RoboCup Rescue Simulation Fire brigade agent’s decision making process and it learned a good strategy to save civilians and city from fire. The utilized method increases the speed of learning and it has very low memory usage. The effectiveness of the proposed method is shown through simulation results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kitano, H., Tadokoro, S.: RoboCup rescue: A grand challenge for multiagent and intelligent systems. AI Magazine 22(1), 39–52 (2001)

    Google Scholar 

  2. Takeshi, M.: How to develop a RoboCupRescue agent (2000)

    Google Scholar 

  3. Nanjanath, M., Erlandson, A.J., Andrist, S., Ragipindi, A., Mohammed, A.A., Sharma, A.S., Gini, M.: Decision and Coordination Strategies for RoboCup Rescue Agents. In: Ando, N., Balakirsky, S., Hemker, T., Reggiani, M., von Stryk, O. (eds.) SIMPAR 2010. LNCS, vol. 6472, pp. 473–484. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  4. Fave, F.M.D., Packer, H., Pryymak, O., Stein, S., Stranders, u., Tran-Thanh, L., Vytelingum, P., Williamson, S.A., Jennings, N.R.: RoboCupRescue 2010 Rescue Simulation League Team Description IAMRescue, United Kingdom) (2010)

    Google Scholar 

  5. Shahbazi, H., Zafarani, R.: Priority Extraction Using Delayed Rewards in Multi Agents Systems: A Case Study in RoboCup. In: CSICC 2006, Iran, pp. 571–574 (2006)

    Google Scholar 

  6. Shahgholi Ghahfarokhi, B., Shahbazi, H., Kazemifard, M., Zamanifar, K.: Evolving Fuzzy Neural Network Based Fire Planning in Rescue Firebrigade Agents. In: SCSC 2006, Canada (2006)

    Google Scholar 

  7. Paquet, S., Bernier, N., Chaib-draa, B.: Comparison of Different Coordination Strategies for the RoboCup Rescue Simulation. In: Orchard, B., Yang, C., Ali, M. (eds.) IEA/AIE 2004. LNCS (LNAI), vol. 3029, pp. 987–996. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  8. Mohammadi, Y.B., Tazari, A., Mehrandezh, M.: A new hybrid task sharing method for cooperative multi agent systems. In: Canadian Conf. on Electrical and Computer Engineering (May 2005)

    Google Scholar 

  9. Martínez, I.C., Ojeda, D., Zamora, E.A.: Ambulance Decision Support using Evolutionary Reinforcement Learning in RoboCup Rescue Simulation League. In: Lakemeyer, G., Sklar, E., Sorrenti, D.G., Takahashi, T. (eds.) RoboCup 2006: Robot Soccer World Cup X. LNCS (LNAI), vol. 4434, pp. 556–563. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  10. Paquet, S., Bernier, N., Chaib-draa, B.: From global selective perception to local selective perception. In: AAMAS, pp. 1352–1353 (2004)

    Google Scholar 

  11. Amraii, S.A., Behsaz, B., Izadi, M.: S.o.s 2004: An attempt towards a multi-agent rescue team. In: Proc. 8th RoboCup Int’l Symposium (2004)

    Google Scholar 

  12. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Abdolmaleki, A., Movahedi, M., Salehi, S., Lau, N., Reis, L.P. (2011). A Reinforcement Learning Based Method for Optimizing the Process of Decision Making in Fire Brigade Agents. In: Antunes, L., Pinto, H.S. (eds) Progress in Artificial Intelligence. EPIA 2011. Lecture Notes in Computer Science(), vol 7026. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24769-9_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24769-9_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24768-2

  • Online ISBN: 978-3-642-24769-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics