Skip to main content

Advertisement

Log in

Bio-insect and artificial robot interaction: learning mechanism and experiment

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This paper addresses fuzzy-logic-based reinforcement learning architecture and experimental results for the interaction between an artificial robot and a living bio-insect. The main goal of this research is to drag the bio-insect towards the desired goal area without any human aid. To achieve the goal, we seek to design robot intelligence architecture such that the robot can drag the bio-insect using its own learning mechanism. The main difficulties of this research are to find an interaction mechanism between the robot and bio-insect and to design a robot intelligence architecture. In simple interaction experiment, the bio-insect does not react to stimuli such as light, vibration, or artificial robot motion. From various trials-and-error efforts, we empirically found an actuation mechanism for the interaction between the robot and bio-insect. Nevertheless, it is difficult to control the movement of the bio-insect due to its uncertain and complex behavior. For the artificial robot, we design a fuzzy-logic-based reinforcement learning architecture that helps the artificial robot learn how to control the movement of the bio-insect under uncertain and complex behavior. Here, we present the experimental results regarding the interaction between an artificial robot and a bio-insect.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. Reference from: http://www.conceptlab.com/roachbot/.

  2. Reader can download all movie clips by visiting our web site: http://dcas.gist.ac.kr/brids.

References

  • Altas I, Sharaf A (2008) A novel maximum power fuzzy logic controller for photovoltaic solar energy systems. Renew Energy 33(3):388–399

    Article  Google Scholar 

  • Antonelli G, Chiaverini S, Fusco G (2007) A fuzzy-logic-based approach for mobile robot path tracking. IEEE Trans Fuzzy Syst 15(2):211–221

    Article  Google Scholar 

  • Büyüközkan G, Feyzıoglu O (2004) A fuzzy-logic-based decision-making approach for new product development. Int J Prod Econ 90(1):27–45

    Article  Google Scholar 

  • Caprari G, Colot A, Siegwart R, Halloy J, Deneubourg JL (2004) Insbot: design of an autonomous moni mobile robot able to interact with cockroaches. In: Proceedings of IEEE international conference on robotics and automation, New Orleans, Louisiana, pp 2418–2423

  • Caprari G, Colot A, Siegwart R, Halloy J, Deneubourg JL (2005) Building mixed societies of animals and robots. IEEE Robot Autom Mag 12(2):58–65

    Article  Google Scholar 

  • Choi YC, Ahn HS (2009) Bio-insect and artificial robots interaction based on multi-agent reinforcement learning. IEEE/ASME international conference on mechatronics and embedded systems and applications, San diego, California, pp 9–15

  • Dash S, Rengaswamy R, Venkatasubramanian V (2003) Fuzzy-logic based trend classification for fault diagnosis of chemical processes. Comput Chem Eng 27(3):347–362

    Article  Google Scholar 

  • Dayan P, Niv Y (2008) Reinforcement learning: the good, the bad and the ugly. Curr Opin Neurobiol 18(2):185–196

    Article  Google Scholar 

  • Doitsidis L, Valavanis KP, Tsourveloudis NC, Kontitsis M (2004) A framework for fuzzy logic based uav navigation and control. In: 2004 IEEE international conference on robotics and automation, 2004. Proceedings of ICRA’04, vol 4. IEEE, pp 4041–4046

  • Er MJ, Deng C (2004) Online tuning of fuzzy inference systems using dynamic fuzzy q-learning. IEEE Trans Syst Man Cybern Part B Cybern 34(3):1478–1489

    Article  Google Scholar 

  • Holzer R, Shimoyama I (1997) Locomotion control of a bio-robotic system via electric stimulation Holzer Shimoyama. In: Proceedings of the 1997 IEEE/RSJ international conference on intelligent robots and systems, vol 3. Grenoble, France, pp 1514–1519

  • Jeanson R, Rivault C, Deneubourg JL, Blanco S, Fournier R, Jost C, Theraulaz G (2005) Self-organised aggregation in cockroaches. Anim Behav 69(1):169–180

    Article  Google Scholar 

  • Juang CF, Hsu CH (2009) Reinforcement ant optimized fuzzy controller for mobile-robot wall-following control. IEEE Trans Ind Electron 56(10):3931–3940

    Article  Google Scholar 

  • Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artif Intell Res 4:237–285

    Google Scholar 

  • Kim H, Jordan MI, Sastry S, Ng A (2003) Autonomous helicopter flight via reinforcement learning. In: Advances in neural information processing systems

  • Kuwana Y, Nagasawa S, Shimoyama I, Kanzaki R (1999) Synthesis of the pheromone-oriented behaviour of silkworm moths by a mobile robot with moth antennae as pheromone sensors. Biosens Bioelectron 14(2):195–202

    Google Scholar 

  • Lanzi P (2002) Learning classifier systems from a reinforcement learning perspective. Soft Comput 6(3):162–170

    Article  MATH  Google Scholar 

  • Lin CK (2003) A reinforcement learning adaptive fuzzy controller for robots. Fuzzy Sets Syst 137(3):339–352

    Article  MATH  Google Scholar 

  • Lin J, Lewis FL (2003) Two-time scale fuzzy logic controller of flexible link robot arm. Fuzzy Sets Syst 139(1):125–149

    Article  MATH  MathSciNet  Google Scholar 

  • Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7(1):1–13

    Article  MATH  Google Scholar 

  • Nikravesh M (2008) Evolution of fuzzy logic: from intelligent systems and computation to human mind. Soft Comput 12(2):207–214

    Article  Google Scholar 

  • Peters J, Vijayakumar S, Schaal S (2003) Reinforcement learning for humanoid robotics. In: Proceedings of the third IEEE-RAS international conference on humanoid robots, pp 1–20

  • Purnamadjaja AH, Russell RA (2007) Guiding robots behaviors using pheromone communication. Autonom Robots 23(2):113–130

    Article  Google Scholar 

  • Son JH, Ahn HS (2008) Cooperative reinforcement learning: brief survey and application to bio-insect and artificial robot interaction. In: IEEE/ASME international conference on mechtronic and embedded systems and applications, Beijing, China, pp 71–76

  • Son JH, Ahn HS (2009a) Fuzzy reward based cooperative reinforcement learning for bio-insect and artificial robot interaction. In: IEEE/ASME international conference mechatronics and embedded systems and applications, San diego, California, pp 17–25

  • Son JH, Ahn HS (2009b) Bio-insect and artificial robots interaction: a dragging mechanism and experimental results. In: IEEE international symposium on computational intelligence in robotics and automation (CIRA). IEEE, Daejeon, Korea, pp 138–141

  • Son JH, Ahn HS (2009c) Design a hardware platform of BRIDS (Bio-insect and artificial Robot Interaction based on Distributed Systems) for cooperative reinforcement learning experiment. (written in Korean). In: Korea automatic control conference (KACC). Busan, Korea

  • Son JH, Ahn HS (2012) Bio-insect and artificial robot interaction using cooperative reinforcement learning. In: 2012 IEEE international symposium on intelligent control (ISIC). IEEE, pp 1190–1194

  • Sugeno M, Yasukawa T (1993) A fuzzy-logic-based approach to qualitative modeling. IEEE Trans Fuzzy Syst 1(1):7–31

    Article  Google Scholar 

  • Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge

    Google Scholar 

  • Waslander SL, Hoffmann GM, Jang JS, Tomlin CJ (2005) Multi-agent quadrotor testbed control design: integral sliding mode vs. reinforcement learning. In: 2005 IEEE/RSJ international conference on intelligent robots and systems (IROS 2005). IEEE, pp 3712–3717

  • Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning-I. Inf Sci 8(3):199–249

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgments

This research was supported by the National Research Foundation of Korea (NRF) (No. NRF-2011-0021474).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hyo-Sung Ahn.

Additional information

Communicated by A. Lotfi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Son, JH., Ahn, HS. Bio-insect and artificial robot interaction: learning mechanism and experiment. Soft Comput 18, 1127–1141 (2014). https://doi.org/10.1007/s00500-013-1133-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-013-1133-4

Keywords

Navigation