Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Hexagon-Based Q-Learning to Find a Hidden Target Object

  • Conference paper
Computational Intelligence and Security (CIS 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3801))

Included in the following conference series:

  • 1246 Accesses

Abstract

This paper presents the hexagon-based Q-leaning to find a hidden target object with multiple robots. We set up an experimental environment with three small mobile robots, obstacles, and a target object. The robots were out to search for a target object while navigating in a hallway where some obstacles were placed. In this experiment, we used two control algorithms: an area-based action making (ABAM) process to determine the next action of the robots and hexagon-based Q-learning to enhance the area-based action making process.

This research was supported by the Brain Neuroinformatics Research, Jul. 2004 to Mar. 2008, Program by Ministry of Commerce, Industry, and Energy in Korea.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Parker, L.: Adaptive Action Selection for Cooperative Agent Teams. In: Proc. of 2nd Int. Conf. on Simulation of Adaptive Behavior, pp. 442–450 (1992)

    Google Scholar 

  2. Ogasawara, G., Omata, T., Sato, T.: Multiple Movers Using Distributed, Decision-Theoretic Control. In: Proc. of Japan-USA Symp. on Flexible Automation, vol. 1, pp. 623–630 (1992)

    Google Scholar 

  3. Ballard, D.: An Introduction to Natural Computation. The MIT Press, Cambridge (1997)

    Google Scholar 

  4. Jang, J., Sun, C., Mizutani, E.: Neuro-Fuzzy and Soft Computing. Prentice-Hall, New Jersey (1997)

    Google Scholar 

  5. Ashley, W., Balch, T.: Value-Based Observation with Robot Teams (VBORT) using Probabilistic Techniques. In: Proc. of Int. Conf. on Advanced Robotics (2003)

    Google Scholar 

  6. Ashley, W., Balch, T.: Value-Based Observation with Robot Teams (VBORT) for Dynamic Targets. In: Proc. of Int. Conf. on Intelligent Robots and Systems (2003)

    Google Scholar 

  7. Park, J.B., Lee, B.H., Kim, M.S.: Remote Control of a Mobile Robot Using Distance-Based Reflective Force. In: Proc. of IEEE Int. Conf. on Robotics and Automation, vol. 3, pp. 3415–3420 (2003)

    Google Scholar 

  8. Mitchell, T.: Machine Learning. McGraw-Hill, Singapore (1997)

    MATH  Google Scholar 

  9. Clausen, C., Wechsler, H.: Quad-Q-Learning. IEEE Trans. on Neural Network 11, 279–294 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Electronics Engineering, Chung-Ang University, 221 Heukseok-Dong, Dongjak-Gu, Seoul, 156–756, Korea

    Han-Ul Yoon & Kwee-Bo Sim

Authors
  1. Han-Ul Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kwee-Bo Sim
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microelectronic Instiute, Xidian University, 710071, Xi’an, China

    Yue Hao

  2. Department of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong

    Jiming Liu

  3. School of Computer Science and Technology, Xidian University, Xi’an, China

    Yuping Wang

  4. Department of Computer Science, Hong Kong Baptist University, Hong Kong,  

    Yiu-ming Cheung

  5. School of Electrical and Electronic Engineering, University of Manchester, UK

    Hujun Yin

  6. Life Science Research Center, School of Electronic Engineering, Xidian University, 710071, Xi’an, Shaanxi, China

    Licheng Jiao

  7. Key Laboratory of Computer Networks and Information Security (Ministry of Education), Xidian University, 710071, Xi’an, China

    Jianfeng Ma

  8. National Laboratory of Antennas and Microwave Technology, Xidian University, 710071, Xi’an, Shanxi, P.R. China

    Yong-Chang Jiao

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yoon, HU., Sim, KB. (2005). Hexagon-Based Q-Learning to Find a Hidden Target Object. In: Hao, Y., et al. Computational Intelligence and Security. CIS 2005. Lecture Notes in Computer Science(), vol 3801. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11596448_63

Download citation

  • DOI: https://doi.org/10.1007/11596448_63

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30818-8

  • Online ISBN: 978-3-540-31599-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation