Abstract
Early human motor development has the nature of spontaneous exploration and boot-strap learning, leading to open-ended acquisition of versatile flexible motor skills. Since dexterous motor skills often exploit body-environment dynamics, we formulate the developmental principle as the spontaneous exploration of consistent dynamical patterns of the neural-body-environment system. We propose that partially ordered dynamical patterns emergent from chaotic oscillators coupled through embodiment serve as the core driving mechanism of such exploration. A model of neuro-musculo-skeletal system is constructed capturing essential features of biological systems. It consists of a skeleton, muscles, spindles, tendon organs, spinal circuits, medullar circuits (CPGs), and a basic cortical model. Through a series of experiments with a minimally simple body model, it is shown that the model has the capability of generating partially ordered behavior, a mixture of chaotic exploration and ordered entrained patterns. Models of self-organizing cortical areas for primary somatosensory and motor areas are introduced. They participate in the explorative learning by simultaneously learning and controlling the movement patterns. A scaled up version of the model, a human infant model, is constructed and put through preliminary experiments. Some meaningful motor behavior emerged including rolling over and crawling-like motion. The results show the possibility that a rich variety of meaningful behavior can be discovered and acquired by the neural-body dynamics without pre-defined coordinated control circuits.
Similar content being viewed by others
References
Aoi S, Tsuchiya K (2006) Bifurcation and chaos of a simple walking model driven by a rhythmic signal. Int J Non linear Mech 41(3):438–446
Arena P, Caponnetto R, Fortuna L, Rosa ML, Rizzo A (2000) Nonorganized deterministic dissymetries induce regularity in patiotemporal dynamics. Int J Bifurc Chaos 10(1):73-85
Asai Y, Nomura T, Sato S (2000) Emergence of oscillations in a model of weakly coupled two bonhoeffer van der pol equations. BioSystems 58:239–247
Asai Y, Nomura T, Sato S, Tamaki A, Matsuo Y, Mizukura I, Abe K (2003) A coupled oscillator model of disordered interlimb coordination in patients with parkinson disease. Biol Cybern 88:152–162
Bernstein NA (1996) On dexterity and its development. In: Latash ML, Turvey MT (eds) Dexterity and Its Development, Lawrence Erlbaum Associates pp. 3-4
Chen Y (1997) A motor control model based on self-organizing feature maps. Ph.D. thesis, the University of Maryland
Collins JJ, Richmond SA (1994) Hard-wired central pattern generators for quadrupedal locomotion. Biol Cybern 71(5):375–385
Crair MC (1999) Neuronal activity during development: permissive or instructive?. Curr Opin Neurobiol 9:88–93
Freivalds A Incorporation of active elements into the articulated total body model. Paper aamrl-tr-85-061, Armstrong Aerospace Medical Research Laboratory
Friederich JA, Brand RA (1990) Muscle fiber architecture in the human lower limb. J Biomech 23(1):91–95
Fukunaga T (1967) Computation of muscle force per unit muscle cross-section based on ultrasonic measurements (in Japanese). Jpn J Phy Educ 14(1):28–31
Goodall S, Reggia J, Chen Y, Ruppin E, Whitney C (1997) A computational model of acute focal cortical lesions. Stroke 28:101–109
Grillner S et al. (1991) Neuronal network generating locomotor behavior in lamprey: circuitry, transmitters, membrane properties and simulation. Ann Rev Neurosc 14:169–199
Hakamada S, Hayakawa F, Kuno K, Tanaka R (1988) Development of the monosynaptic reflex pathway in the human spinal cord. Dev Brain Res 42:239–246
He J, Maltenfort MG, Wang Q, Hamm TM (2001) Learning from biological systems : modeling neural control. Control Syst Mag 21(4):55–69
Hill AV (1938) The heat of shortening and the dynamic constants of muscle. Proc R Soc Lond B126:136–195
Ijspeert AJ (2001) A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander. Biol Cybern 84(5):331–348
Inui K, Wang X, Tamura Y, Kaneoke Y, Kakigi R (2004) Serial processing in the human somatosensory system. Cere Cortex 14:851–857
Issler H, Stephens JA (1983) The maturation of cutaneous reflexes studied in the upper limb in man. J Physiol 335:643–654
Johnson MH (2005) Developmental Cognitive Neuroscience, 2nd edn. Blackwell, Oxford
Kaneko K (1984) Period-doubling of kink-antikink patterns, quasi-periodicity in antiferro-like structures and spatial intermittency in coupled map lattices—toward a prelude to a “field theory of chaos” Prog Theor Phys 72:480–486
Kaneko K (1989) Chaotic but regular posi-nega switch among coded attractors by cluster size variation. Phys Rev Lett 63:219
Kaneko K (1990) Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements. Physica D 41:137–172
Kaneko K (1994) Relevance of clustering to biological networks. Physica D 77:456
Kaneko K, Tsuda I (2001) Complex Systems: Chaos and Beyond. Springer, Berlin Heidelberg New York
Kimura H, Fukuoka Y, Konaga K (2001) Adaptive dynamic walking of a quadruped robot by using neural system model. Adv Robot 15(8):859–876
Kisilevsky B, Low J (1998) Human fetal behavior: 100 years of study. Dev Rev 18:1–29
Kohonen T (1997) Self-Organizing Maps (2nd edn.). No. 30 in Springer Series in Information Sciences. Springer, Berlin New York
Kuniyoshi Y, Ohmura Y, Terada K, Nagakubo A (2004) Dynamic roll-and-rise motion by an adult-size humanoid robot. Int J Humanoid Robot 1(3):497–516
Kuniyoshi Y, Suzuki S (2004) Dynamic emergence and adaptation of behavior through embodiment as coupled chaotic field. In: Proceedings of IEEE International Conference on Intelligent Robots and Systems, pp. 2042-049
Kuniyoshi Y et al. (2004) Embodied basis of invariant features in execution and perception of whole body dynamic actions—knacks and focuses of roll-and-rise motion. Robotics and Autonomous Systems 48(4):189–201
Lin CCK, Crago PE (2002) Neural and mechanical contributions to the stretch reflex: a model synthesis. Ann Biomed Eng 30:54–67
Maruyama H (ed) (2005) Clinical Kinesiology, 4th edn (in Japanese). The Society of Physical Therapy Science
Matsumoto K, Tsuda I (1983) Noise-induced order. J Stat Phys 31:87
McGeer T (1990) Passive dynamic walking. Int J Robot Res 9(2):62–82
Morimoto J, Doya K (2001) Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robot Auton Syst 36(1):37–51
Ott E, Grebogi C, Yorke JA (1990) Controlling chaos. Phys Rev Lett 64(11):1196–1199
Pribe C, Grossberg S, Cohen MA (1997) Neural control of interlimb oscillations ii. biped and quadruped gaits and bifurcations. Biol Cybern 77(2)
Rakic P (1998) Specification of cerebral cortical areas. Science 241:170–176
Ressler S (1977) Anthrokids—anthropometric data of children http://www.itl.nist.gov/iaui/ovrt/projects/anthrokids/
Rizzi AA, Koditschek DE (1993) Further progress in robot juggling: The spatial two-juggle. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 919-24
Sarnat HB (2003) Functions of the corticospinal and corticobulbar tracts in the human newborn. J. of Pediat. Neurol. 1(1):3–8
Sato M, Nakamura Y, Ishii S (2002) Reinforcement Learning for Biped Locomotion, Lecture Notes in Computer Science, vol 2415/2002 Springer, Berlin Heidelberg New York p. 777
Scholten RR, Pillen S, Verrips A, Zwarts MJ (2003) Quantitative ultrasonography of skeletal muscles in children: Normal values. Muscle Nerve 27:693–698
Shue G, Crago PE (1998) Muscle-tendon model with length history-dependent activation-velocity coupling. Ann Biomed Eng 26:369–380
Small M, Judd K, Lowe M, Stick S (1999) Is breathing in infants chaotic? dimension estimates for respiratory patterns during quiet sleep. J Appl Physiol 86:359–376
Smith LK, Weiss EL, Lehmkuhl DL (1996) Brunnstrom’s Clinical Kinesiology. F.A. Davis Co
Spoor CW, van Leeuwen JL, de Windt FH, Huson A (1989) a model study of muscle forces and joint-force direction in normal and dysplastic neonatal hips. J Biomech 22(8–9):873–884
Sun H, Jensen R (1994) Body segment growth during infancy. J Biomech 21(3):265–275
Taga G (1994) Emergence of bipedal locomotion through entrainment among the neuromusculo-skeletal system and the environment. Physica D 75(1-3):190–208
Taga G, Takaya R, Konishi Y (1999) Analysis of general movements of infants towards understanding of developmental principle for motor control. In: Proceedings of IEEE International Conference on Systems, Man, Cybernetics, vol 5, pp 678-83 (1999)
Taga G, Yamaguchi Y, Shimizu H (1991) Self-organized control of bipedal locomotion in unpredictable environment. Biol. 65:147–159
Tsuda I (1991) Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind. World Futures 32, 167 (1991)
Watanabe H, Ogata K, Ogata T (1979) On mobile range of four limbs of normal japanese—variation with age (in Japanese). J Jpn Orthop Assoc 53(3):275–291
Wisse M, van Frankenhuyzen J (2006) Design and construction of mike; a 2-D autonomous biped based on passive dynamic walking. In: Kimura H, Tsuchiya K, Ishiguro A, Witte H (eds) Adaptive Motion of Animals and Machines, vol 4, Springer, Tokyo pp 143-54
Wood JE, Meek SG, Jacobsen SC (1989a) Quantitation of human shoulder anatomy for prosthetic arm control—i. surface modelling. J Biomech 22(3):273–292
Wood JE, Meek SG, Jacobsen SC (1989b) Quantitation of human shoulder anatomy for prosthetic arm control–ii. anatomy matrices. J Biomech 22(4):309–325
Yang Z, França FMG (2003) A generalized locomotion cpg architecture based on oscillatory building blocks. Biol Cybern 89(1):34–42
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kuniyoshi, Y., Sangawa, S. Early motor development from partially ordered neural-body dynamics: experiments with a cortico-spinal-musculo-skeletal model. Biol Cybern 95, 589–605 (2006). https://doi.org/10.1007/s00422-006-0127-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-006-0127-z