Skip to main content

An Intrinsic Neuromodulation Model for Realizing Anticipatory Behavior in Reaching Movement under Unexperienced Force Fields

  • Conference paper
Book cover Anticipatory Behavior in Adaptive Learning Systems (ABiALS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4520))

Included in the following conference series:

  • 915 Accesses

Abstract

Regardless of complex, unknown, and dynamically-changing environments, living creatures can recognize situated environments and behave adaptively in real-time. However, it is impossible to prepare optimal motion trajectories with respect to every possible situations in advance. The key concept for realizing the environment cognition and motor adaptation is a context-based elicitation of constraints which are canalizing well-suited sensorimotor coordination. For this aim, in this study, we propose a polymorphic neural networks model called CTRNN+NM (CTRNN with neuromodulatory bias). The proposed model is applied to two dimensional arm-reaching movement control under various viscous force fields. The parameters of the networks are optimized using genetic algorithms. Simulation results indicate that the proposed model inherits high robustness even though it is situated in unexperienced environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Beer, R.D.: Dynamical approaches to cognitive science. Trend in Cognitive Sciences 4-3, 91–99 (2000)

    Article  Google Scholar 

  2. Bernstein, N.: The Coordination and Regulation of Movements. Pergamon, Oxford (1967)

    Google Scholar 

  3. Di Paolo, E.A.: Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions. From animals to animat 6, pp. 440–449. MIT Press, Cambridge (2000)

    Google Scholar 

  4. Eggenberger, P., Ishiguro, A., Tokura, S., Kondo, T., Uchikawa, Y.: Toward Seamless Transfer from Simulated to Real Worlds: A Dynamically-Rearranging Neural Network Approach. In: Demiris, J., Wyatt, J.C. (eds.) Advances in Robot Learning. LNCS (LNAI), vol. 1812, pp. 44–60. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  5. Getting, P.A., Dekin, M.S.: Tritonia swimming: A model system for integration within rhythmic motor systems. In: Selverston, A.I. (ed.) Model neural networks and behavior, pp. 3–20. Plenum Press, New York (1985)

    Google Scholar 

  6. Haken, H.: Principles of Brain Functioning. Springer-Verlag, Berlin Heidelberg (1996)

    MATH  Google Scholar 

  7. Hasselmo, M.: Neuromodulation and cortical function: modeling the physiological basis of behavior. Behavioral Brain Research 67, 1–27 (1995)

    Article  Google Scholar 

  8. Husbands, P., Smith, T.M.C., Jakobi, N., O’Shea, M.: Better Living Through Chemistry: Evolving GasNets for Robot Control. Connection Science 10(3-4), 185–210 (1998)

    Article  Google Scholar 

  9. Ishiguro, A., Fujii, A., Eggenberger, P.: Neuromodulated Control of Bipedal Locomotion Using a Polymorphic CPG Circuit. Adaptive Behavior 11-1, 7–17 (2003)

    Article  Google Scholar 

  10. Karniel, A., Mussa-Ivaldi, F.A.: Sequence, time, or state representation: how does the motor control system adapt to variable environments? Biological Cybernetics 89-1, 10–21 (2003)

    Google Scholar 

  11. Kondo, T.: Evolutionary design and behavior analysis of neuromodulatory neural networks for mobile robots control. Applied Soft Computing, vol. 7-1, pp. 189–202. Elsevier, North-Holland, Amsterdam (2007)

    Google Scholar 

  12. Kondo,T., Ishiguro, A., Tokura, S., Uchikawa, Y., Eggenberger, P.: Realization of Robust Controllers in Evolutionary Robotics: A Dynamically-rearranging Neural Network Approach, In: Proceedings of the 1999 Congress of Evolutionary Computation, vol.1, pp. 366–373 (1999)

    Google Scholar 

  13. Marder, E., Thirumalai, V.: Cellular, synaptic and network effects of neuromodulation. Neural Networks 15, 479–493 (2002)

    Article  Google Scholar 

  14. Meyrand, P., Simmers, J., Moulins, M.: Construction of a pattern-generating circuit with neurons of different networks. NATURE 351, 60–63 (1991)

    Article  Google Scholar 

  15. Paine, R.W., Tani, J.: Motor primitive and sequence self-organization in a hierarchical recurrent neural network. Neural Networks 17, 1291–1309 (2004)

    Article  Google Scholar 

  16. Poggio, T., Bizzi, E.: Generalization in vision and motor control Insight Review Articles. Nature 431, 768–774 (2004)

    Article  Google Scholar 

  17. Schöner, G., Kelso, J.A.S.: Dynamic pattern generation in behavioral and neural systems. Science 239, 1513–1520 (1988)

    Article  Google Scholar 

  18. Smith, R.: Open dynamics engine v0.5 user guide (2004), http://ode.org/

  19. Smith, T.M.C., Husbands, P., Philippides, A., O’Shea, M.: Neuronal Plasticity and Temporal Adaptivity: GasNet Robot Control Networks. Adaptive Behavior 10(3–4), 161–183 (2002)

    Google Scholar 

  20. Tani, J.: Learning to generate articulated behavior through the bottom-up and the top-down interaction processes. Neural Networks 16, 11–23 (2003)

    Article  Google Scholar 

  21. Thelen, E., Smith, L.B.: A Dynamic Systems Approach to the Development of Cognition and Action. MIT Press, Cambridge (1994)

    Google Scholar 

  22. Wolpert, D.M., Kawato, M.: Multiple paired forward and inverse models for motor control. Neural Networks 11, 1317–1329 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Martin V. Butz Olivier Sigaud Giovanni Pezzulo Gianluca Baldassarre

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kondo, T., Ito, K. (2007). An Intrinsic Neuromodulation Model for Realizing Anticipatory Behavior in Reaching Movement under Unexperienced Force Fields. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds) Anticipatory Behavior in Adaptive Learning Systems. ABiALS 2006. Lecture Notes in Computer Science(), vol 4520. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74262-3_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74262-3_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74261-6

  • Online ISBN: 978-3-540-74262-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics