Skip to main content
Log in

Early motor development from partially ordered neural-body dynamics: experiments with a cortico-spinal-musculo-skeletal model

  • Original Paper
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

Early human motor development has the nature of spontaneous exploration and boot-strap learning, leading to open-ended acquisition of versatile flexible motor skills. Since dexterous motor skills often exploit body-environment dynamics, we formulate the developmental principle as the spontaneous exploration of consistent dynamical patterns of the neural-body-environment system. We propose that partially ordered dynamical patterns emergent from chaotic oscillators coupled through embodiment serve as the core driving mechanism of such exploration. A model of neuro-musculo-skeletal system is constructed capturing essential features of biological systems. It consists of a skeleton, muscles, spindles, tendon organs, spinal circuits, medullar circuits (CPGs), and a basic cortical model. Through a series of experiments with a minimally simple body model, it is shown that the model has the capability of generating partially ordered behavior, a mixture of chaotic exploration and ordered entrained patterns. Models of self-organizing cortical areas for primary somatosensory and motor areas are introduced. They participate in the explorative learning by simultaneously learning and controlling the movement patterns. A scaled up version of the model, a human infant model, is constructed and put through preliminary experiments. Some meaningful motor behavior emerged including rolling over and crawling-like motion. The results show the possibility that a rich variety of meaningful behavior can be discovered and acquired by the neural-body dynamics without pre-defined coordinated control circuits.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aoi S, Tsuchiya K (2006) Bifurcation and chaos of a simple walking model driven by a rhythmic signal. Int J Non linear Mech 41(3):438–446

    Article  Google Scholar 

  • Arena P, Caponnetto R, Fortuna L, Rosa ML, Rizzo A (2000) Nonorganized deterministic dissymetries induce regularity in patiotemporal dynamics. Int J Bifurc Chaos 10(1):73-85

    Article  Google Scholar 

  • Asai Y, Nomura T, Sato S (2000) Emergence of oscillations in a model of weakly coupled two bonhoeffer van der pol equations. BioSystems 58:239–247

    Article  CAS  PubMed  Google Scholar 

  • Asai Y, Nomura T, Sato S, Tamaki A, Matsuo Y, Mizukura I, Abe K (2003) A coupled oscillator model of disordered interlimb coordination in patients with parkinson disease. Biol Cybern 88:152–162

    Article  PubMed  Google Scholar 

  • Bernstein NA (1996) On dexterity and its development. In: Latash ML, Turvey MT (eds) Dexterity and Its Development, Lawrence Erlbaum Associates pp. 3-4

  • Chen Y (1997) A motor control model based on self-organizing feature maps. Ph.D. thesis, the University of Maryland

  • Collins JJ, Richmond SA (1994) Hard-wired central pattern generators for quadrupedal locomotion. Biol Cybern 71(5):375–385

    Article  Google Scholar 

  • Crair MC (1999) Neuronal activity during development: permissive or instructive?. Curr Opin Neurobiol 9:88–93

    Article  CAS  PubMed  Google Scholar 

  • Freivalds A Incorporation of active elements into the articulated total body model. Paper aamrl-tr-85-061, Armstrong Aerospace Medical Research Laboratory

  • Friederich JA, Brand RA (1990) Muscle fiber architecture in the human lower limb. J Biomech 23(1):91–95

    Article  CAS  PubMed  Google Scholar 

  • Fukunaga T (1967) Computation of muscle force per unit muscle cross-section based on ultrasonic measurements (in Japanese). Jpn J Phy Educ 14(1):28–31

    Article  Google Scholar 

  • Goodall S, Reggia J, Chen Y, Ruppin E, Whitney C (1997) A computational model of acute focal cortical lesions. Stroke 28:101–109

    CAS  PubMed  Google Scholar 

  • Grillner S et al. (1991) Neuronal network generating locomotor behavior in lamprey: circuitry, transmitters, membrane properties and simulation. Ann Rev Neurosc 14:169–199

    Article  CAS  Google Scholar 

  • Hakamada S, Hayakawa F, Kuno K, Tanaka R (1988) Development of the monosynaptic reflex pathway in the human spinal cord. Dev Brain Res 42:239–246

    Article  Google Scholar 

  • He J, Maltenfort MG, Wang Q, Hamm TM (2001) Learning from biological systems : modeling neural control. Control Syst Mag 21(4):55–69

    Article  Google Scholar 

  • Hill AV (1938) The heat of shortening and the dynamic constants of muscle. Proc R Soc Lond B126:136–195

    Article  Google Scholar 

  • Ijspeert AJ (2001) A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander. Biol Cybern 84(5):331–348

    Article  CAS  PubMed  Google Scholar 

  • Inui K, Wang X, Tamura Y, Kaneoke Y, Kakigi R (2004) Serial processing in the human somatosensory system. Cere Cortex 14:851–857

    Article  Google Scholar 

  • Issler H, Stephens JA (1983) The maturation of cutaneous reflexes studied in the upper limb in man. J Physiol 335:643–654

    CAS  PubMed  Google Scholar 

  • Johnson MH (2005) Developmental Cognitive Neuroscience, 2nd edn. Blackwell, Oxford

    Google Scholar 

  • Kaneko K (1984) Period-doubling of kink-antikink patterns, quasi-periodicity in antiferro-like structures and spatial intermittency in coupled map lattices—toward a prelude to a “field theory of chaos” Prog Theor Phys 72:480–486

    Article  Google Scholar 

  • Kaneko K (1989) Chaotic but regular posi-nega switch among coded attractors by cluster size variation. Phys Rev Lett 63:219

    Article  PubMed  Google Scholar 

  • Kaneko K (1990) Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements. Physica D 41:137–172

    Article  Google Scholar 

  • Kaneko K (1994) Relevance of clustering to biological networks. Physica D 77:456

    Article  Google Scholar 

  • Kaneko K, Tsuda I (2001) Complex Systems: Chaos and Beyond. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Kimura H, Fukuoka Y, Konaga K (2001) Adaptive dynamic walking of a quadruped robot by using neural system model. Adv Robot 15(8):859–876

    Article  Google Scholar 

  • Kisilevsky B, Low J (1998) Human fetal behavior: 100 years of study. Dev Rev 18:1–29

    Article  Google Scholar 

  • Kohonen T (1997) Self-Organizing Maps (2nd edn.). No. 30 in Springer Series in Information Sciences. Springer, Berlin New York

  • Kuniyoshi Y, Ohmura Y, Terada K, Nagakubo A (2004) Dynamic roll-and-rise motion by an adult-size humanoid robot. Int J Humanoid Robot 1(3):497–516

    Article  Google Scholar 

  • Kuniyoshi Y, Suzuki S (2004) Dynamic emergence and adaptation of behavior through embodiment as coupled chaotic field. In: Proceedings of IEEE International Conference on Intelligent Robots and Systems, pp. 2042-049

  • Kuniyoshi Y et al. (2004) Embodied basis of invariant features in execution and perception of whole body dynamic actions—knacks and focuses of roll-and-rise motion. Robotics and Autonomous Systems 48(4):189–201

    Article  Google Scholar 

  • Lin CCK, Crago PE (2002) Neural and mechanical contributions to the stretch reflex: a model synthesis. Ann Biomed Eng 30:54–67

    Article  PubMed  Google Scholar 

  • Maruyama H (ed) (2005) Clinical Kinesiology, 4th edn (in Japanese). The Society of Physical Therapy Science

  • Matsumoto K, Tsuda I (1983) Noise-induced order. J Stat Phys 31:87

    Article  Google Scholar 

  • McGeer T (1990) Passive dynamic walking. Int J Robot Res 9(2):62–82

    Article  Google Scholar 

  • Morimoto J, Doya K (2001) Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robot Auton Syst 36(1):37–51

    Article  Google Scholar 

  • Ott E, Grebogi C, Yorke JA (1990) Controlling chaos. Phys Rev Lett 64(11):1196–1199

    Article  PubMed  Google Scholar 

  • Pribe C, Grossberg S, Cohen MA (1997) Neural control of interlimb oscillations ii. biped and quadruped gaits and bifurcations. Biol Cybern 77(2)

  • Rakic P (1998) Specification of cerebral cortical areas. Science 241:170–176

    Article  Google Scholar 

  • Ressler S (1977) Anthrokids—anthropometric data of children http://www.itl.nist.gov/iaui/ovrt/projects/anthrokids/

  • Rizzi AA, Koditschek DE (1993) Further progress in robot juggling: The spatial two-juggle. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 919-24

  • Sarnat HB (2003) Functions of the corticospinal and corticobulbar tracts in the human newborn. J. of Pediat. Neurol. 1(1):3–8

    Google Scholar 

  • Sato M, Nakamura Y, Ishii S (2002) Reinforcement Learning for Biped Locomotion, Lecture Notes in Computer Science, vol 2415/2002 Springer, Berlin Heidelberg New York p. 777

  • Scholten RR, Pillen S, Verrips A, Zwarts MJ (2003) Quantitative ultrasonography of skeletal muscles in children: Normal values. Muscle Nerve 27:693–698

    Article  CAS  PubMed  Google Scholar 

  • Shue G, Crago PE (1998) Muscle-tendon model with length history-dependent activation-velocity coupling. Ann Biomed Eng 26:369–380

    Article  CAS  PubMed  Google Scholar 

  • Small M, Judd K, Lowe M, Stick S (1999) Is breathing in infants chaotic? dimension estimates for respiratory patterns during quiet sleep. J Appl Physiol 86:359–376

    CAS  PubMed  Google Scholar 

  • Smith LK, Weiss EL, Lehmkuhl DL (1996) Brunnstrom’s Clinical Kinesiology. F.A. Davis Co

  • Spoor CW, van Leeuwen JL, de Windt FH, Huson A (1989) a model study of muscle forces and joint-force direction in normal and dysplastic neonatal hips. J Biomech 22(8–9):873–884

    Article  CAS  PubMed  Google Scholar 

  • Sun H, Jensen R (1994) Body segment growth during infancy. J Biomech 21(3):265–275

    Article  Google Scholar 

  • Taga G (1994) Emergence of bipedal locomotion through entrainment among the neuromusculo-skeletal system and the environment. Physica D 75(1-3):190–208

    Article  Google Scholar 

  • Taga G, Takaya R, Konishi Y (1999) Analysis of general movements of infants towards understanding of developmental principle for motor control. In: Proceedings of IEEE International Conference on Systems, Man, Cybernetics, vol 5, pp 678-83 (1999)

  • Taga G, Yamaguchi Y, Shimizu H (1991) Self-organized control of bipedal locomotion in unpredictable environment. Biol. 65:147–159

    CAS  Google Scholar 

  • Tsuda I (1991) Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind. World Futures 32, 167 (1991)

    Google Scholar 

  • Watanabe H, Ogata K, Ogata T (1979) On mobile range of four limbs of normal japanese—variation with age (in Japanese). J Jpn Orthop Assoc 53(3):275–291

    CAS  Google Scholar 

  • Wisse M, van Frankenhuyzen J (2006) Design and construction of mike; a 2-D autonomous biped based on passive dynamic walking. In: Kimura H, Tsuchiya K, Ishiguro A, Witte H (eds) Adaptive Motion of Animals and Machines, vol 4, Springer, Tokyo pp 143-54

  • Wood JE, Meek SG, Jacobsen SC (1989a) Quantitation of human shoulder anatomy for prosthetic arm control—i. surface modelling. J Biomech 22(3):273–292

    Article  CAS  Google Scholar 

  • Wood JE, Meek SG, Jacobsen SC (1989b) Quantitation of human shoulder anatomy for prosthetic arm control–ii. anatomy matrices. J Biomech 22(4):309–325

    Article  CAS  Google Scholar 

  • Yang Z, França FMG (2003) A generalized locomotion cpg architecture based on oscillatory building blocks. Biol Cybern 89(1):34–42

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yasuo Kuniyoshi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kuniyoshi, Y., Sangawa, S. Early motor development from partially ordered neural-body dynamics: experiments with a cortico-spinal-musculo-skeletal model. Biol Cybern 95, 589–605 (2006). https://doi.org/10.1007/s00422-006-0127-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-006-0127-z

Keywords

Navigation