Skip to main content
Log in

Parabolic movement primitives and cortical states: merging optimality with geometric invariance

  • Original Paper
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

Previous studies have suggested that several types of rules govern the generation of complex arm movements. One class of rules consists of optimizing an objective function (e.g., maximizing motion smoothness). Another class consists of geometric and kinematic constraints, for instance the coupling between speed and curvature during drawing movements as expressed by the two-thirds power law. It has also been suggested that complex movements are composed of simpler elements or primitives. However, the ability to unify the different rules has remained an open problem. We address this issue by identifying movement paths whose generation according to the two-thirds power law yields maximally smooth trajectories. Using equi-affine differential geometry we derive a mathematical condition which these paths must obey. Among all possible solutions only parabolic paths minimize hand jerk, obey the two-thirds power law and are invariant under equi-affine transformations (which preserve the fit to the two-thirds power law). Affine transformations can be used to generate any parabolic stroke from an arbitrary parabolic template, and a few parabolic strokes may be concatenated to compactly form a complex path. To test the possibility that parabolic elements are used to generate planar movements, we analyze monkeys’ scribbling trajectories. Practiced scribbles are well approximated by long parabolic strokes. Of the motor cortical neurons recorded during scribbling more were related to equi-affine than to Euclidean speed. Unsupervised segmentation of simulta- neously recorded multiple neuron activity yields states related to distinct parabolic elements. We thus suggest that the cortical representation of movements is state-dependent and that parabolic elements are building blocks used by the motor system to generate complex movements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abeles M, Bergman H, Gat I, Meilijson I, Seidemann E, Tishby N, Vaadia E (1995) Cortical activity flips among quasi-stationary states. Proc Natl Acad Sci USA 92: 8616–620

    Article  CAS  PubMed  Google Scholar 

  • Averbeck BB, Chafee MV, Crowe DA, Georgopoulos AP (2002) Parallel processing of serial movements in prefrontal cortex. Proc Natl Acad Sci USA 99: 13172–3177

    Article  CAS  PubMed  Google Scholar 

  • Averbeck BB, Crowe DA, Chafee MV, Georgopoulos AP (2003) Neural activity in prefrontal cortex during copying geometrical shapes II. Decoding shape segments from neural ensembles. Exp Brain Res 150: 142–53

    PubMed  Google Scholar 

  • Ben-Shaul Y, Drori R, Asher I, Stark E, Nadasdy Z, Abeles M (2004) Neuronal activity in motor cortical areas reflects the sequential context of movement. J Neurophysiol 91: 1748–762

    Article  PubMed  Google Scholar 

  • Biess A, Liebermann DG, Flash T (2007) Computational model for redundant human 3D pointing movements: integration of independent spatial and temporal motor plans simplifies movement dynamics. J Neurosci 48: 13045–3064

    Article  Google Scholar 

  • Bizzi E, Mussa-Ivaldi FA, Giszter S (1991) Computations underlying the execution of movement—a biological perspective. Science 253: 287–91

    Article  CAS  PubMed  Google Scholar 

  • Bright I (2007) Motion planning through optimization. MSc Thesis, Weizmann Institute of Science

  • Bring J (1996) A geometric approach to compare variables in a regression model. Am Stat 50: 57–2

    Article  Google Scholar 

  • Brockwell A, Kass RE, Schwartz AB (2007) Statistical signal processing and the motor cortex. Proc IEEE 95: 881–98

    Article  Google Scholar 

  • Burdet E, Milner TE (1998) Quantization of human motions and learning of accurate movements. Biol Cybern 78: 307–18

    Article  CAS  PubMed  Google Scholar 

  • Calabi E, Olver PJ, Tannebaum AT (1996) Affine geometry, curve flows, and invariant numerical approximations. Adv Math 124: 154–96

    Article  Google Scholar 

  • Calabi E, Olver PJ, Shakiban C, Tannenbaum A, Haker S (1998) Differential and numerically invariant signature curves applied to object recognition. Int J Comp Vis 26: 107–35

    Article  Google Scholar 

  • Carpenter AF, Georgopoulos AP, Pellizzer G (1999) Motor cortical encoding of serial order in a context-recall task. Science 283: 1752–757

    Article  CAS  PubMed  Google Scholar 

  • Craizer M, Lewiner T, Morvan J-M (2007) Combining points and tangents into parabolic polygons. J Math Imaging Vis 29: 131–40

    Article  Google Scholar 

  • d’Avella A, Bizzi E (2005) Shared and specific muscle synergies in natural motor behaviors. Proc Natl Acad Sci USA 102: 3076–081

    Article  PubMed  Google Scholar 

  • d’Avella A, Saltiel P, Bizzi E (2003) Combinations of muscle synergies in the construction of a natural motor behavior. Nat Neurosci 6: 300–08

    Article  PubMed  Google Scholar 

  • d’Avella A, Portone A, Fernandez L, Lacquaniti F (2006) Control of fast-reaching movements by muscle synergy combinations. J Neurosci 26: 7791–810

    Article  PubMed  Google Scholar 

  • Dayan E, Casile A, Levit-Binnun N, Giese MA, Hendler T, Flash T (2007) Neural representations of kinematic laws of motion: evidence for action-perception coupling. Proc Natl Acad Sci USA 104: 20582–0587

    Article  CAS  PubMed  Google Scholar 

  • Dounskaia N (2007) Kinematic invariants during cyclical arm movements. Biol Cybern 96: 147–63

    Article  PubMed  Google Scholar 

  • Fishbach A, Roy SA, Bastianen C, Miller LE, Houk JC (2005) Kinematic properties of on-line error corrections in the monkey. Exp Brain Res 164: 442–57

    Article  PubMed  Google Scholar 

  • Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 1688–703

    CAS  PubMed  Google Scholar 

  • Flash T, Henis E (1991) Arm trajectory modifications during reaching towards visual targets. J Cogn Neurosci 3: 220–30

    Article  Google Scholar 

  • Flash T, Hochner B (2005) Motor primitives in vertebrates and invertebrates. Curr Opin Neurobiol 15: 660–66

    Article  CAS  PubMed  Google Scholar 

  • Flash T, Handzel AA (2007) Affine differential geometry analysis of human arm movements. Biol Cybern 96: 577–01

    Article  PubMed  Google Scholar 

  • Gat I, Tishby N (1993) Statistical modeling of cell assemblies activities in associative cortex of behaving monkeys. In: Hanson SJ, Cowan JD, Giles SL(eds) Neural information processing systems, vol 5. Denver, Colorado, pp 945–53

    Google Scholar 

  • Gat I, Tishby N, Abeles M (1997) Hidden Markov modelling of simultaneously recorded cells in the associative cortex of behaving monkeys. Netw Comput Neural Syst 8: 297–22

    Article  Google Scholar 

  • Gelfand I, Fomin S (1963) Calculus of variations. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Giszter SF, Mussa-Ivaldi FA, Bizzi E (1993) Convergent force fields organized in the frog’s spinal cord. J Neurosci 13: 467–91

    CAS  PubMed  Google Scholar 

  • Giszter S, Patil V, Hart C (2007) Primitives, premotor drives, and pattern generation: a combined computational and neuroethological perspective. Prog Brain Res 165: 323–46

    Article  PubMed  Google Scholar 

  • Gribble PL, Ostry DJ (1996) Origins of the power law relation between movement velocity and curvature: modeling the effects of muscle mechanics and limb dynamics. J Neurophysiol 76: 2853–2860

    CAS  PubMed  Google Scholar 

  • Guggenheimer HW (1977) Differential geometry. Dover, New York

    Google Scholar 

  • Handzel A, Flash T (1999) Geometric methods in the study of human motor control. Cogn Stud 6: 309–21

    Google Scholar 

  • Handzel A, Flash T (2001) Affine invariant edge completion with affine geodesics. In: IEEE workshop on variational and level set methods, Vancouver, Canada, pp 97–03

  • Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394: 780–84

    Article  CAS  PubMed  Google Scholar 

  • Harris CM, Wolpert DM (2006) The main sequence of saccades optimizes speed-accuracy trade-off. Biol Cybern 95: 21–9

    Article  PubMed  Google Scholar 

  • Hart CB, Giszter SF (2004) Modular premotor drives and unit bursts as primitives for frog motor behaviors. J Neurosci 24: 5269–282

    Article  CAS  PubMed  Google Scholar 

  • Hatsopoulos NG, Paininski L, Donoghue JP (2003) Sequential movement representations based on correlated neuronal activity. Exp Brain Res 149: 478–86

    PubMed  Google Scholar 

  • Hatsopoulos NG, Xu Q, Amit Y (2007) Encoding of movement fragments in the motor cortex. J Neurosci 27: 5105–114

    Article  CAS  PubMed  Google Scholar 

  • Hebb DO (1949) The organization of behavior. Wiley, New York

    Google Scholar 

  • Hogan N (1984) An organizing principle for a class of voluntary movements. J Neurosci 4: 2745–754

    CAS  PubMed  Google Scholar 

  • Ivanenko YP, Grasso R, Macellari V, Lacquaniti F (2002) Two-thirds power law in human locomotion: role of ground contact forces. Neuroreport 13: 1171–174

    Article  PubMed  Google Scholar 

  • Ivanenko YP, Poppele RE, Lacquaniti F (2004) Five basic muscle activation patterns account for muscle activity during human locomotion. J Physiol 556: 267–82

    Article  CAS  PubMed  Google Scholar 

  • Ivanenko YP, Cappellini G, Dominici N, Poppele RE, Lacquaniti F. (2005) Coordination of locomotion with voluntary movements in humans. J Neurosci 25: 7238–253

    Article  CAS  PubMed  Google Scholar 

  • Jackson A, Mavoori J, Fetz EE (2006) Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444: 56–0

    Article  CAS  PubMed  Google Scholar 

  • Johnson MTV, Coltz JD, Ebner TJ (1999) Encoding of target direction and speed during visual instruction and arm tracking in dorsal premotor and primary motor cortical neurons. Eur J Neurosci 11: 4433–445

    Article  CAS  PubMed  Google Scholar 

  • Jones LM, Fontanini A, Sadacca BF, Miller P, Katz DB (2007) Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proc Natl Acad Sci USA 104: 18772–8777

    Article  CAS  PubMed  Google Scholar 

  • Kargo WJ, Giszter SF (2000) Rapid correction of aimed movements by summation of force-field primitives. J Neurosci 20: 409–26

    CAS  PubMed  Google Scholar 

  • Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954–56

    Article  CAS  PubMed  Google Scholar 

  • Kording KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10: 319–26

    Article  PubMed  Google Scholar 

  • Krebs HI, Aisen MI, Volpe BT, Hogan N (1999) Quantization of continuous arm movements in humans with brain injury. Proc Natl Acad Sci USA 96: 4645–649

    Article  CAS  PubMed  Google Scholar 

  • Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychol (Amst) 54: 115–30

    Article  CAS  Google Scholar 

  • Levit-Binnun N, Schechtman E, Flash T (2006) On the similarities between the perception and production of elliptical trajectories. Exp Brain Res 172: 533–55

    Article  PubMed  Google Scholar 

  • Maoz U (2007) Trajectory formation and units of action, from two- to three-dimensional motion. PhD Thesis, The Hebrew University of Jerusalem

  • Maoz U, Berthoz A, Flash T (2008) Complex unconstrained three-dimensional arm movement and constant equi-affine speed. J Nurohysiol. doi:10.1152/jn.90702.2008

  • Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82: 2676–2692

    CAS  PubMed  Google Scholar 

  • Morasso P (1981) Spatial control of arm movements. Exp Brain Res 42: 223–27

    Article  CAS  PubMed  Google Scholar 

  • Morasso P, Mussa Ivaldi FA (1982) Trajectory formation and handwriting: a computational model. Biol Cybern 45: 131–42

    Article  CAS  PubMed  Google Scholar 

  • Mussa-Ivaldi FA, Bizzi E (2000) Motor learning through the combination of primitives. Philos Trans R Soc Lond B Biol Sci 355: 1755–769

    Article  CAS  PubMed  Google Scholar 

  • Mussa-Ivaldi FA, Solla SA (2004) Neural primitives for motion control. IEEE J Ocean Eng 29: 640–50

    Article  Google Scholar 

  • Nakano E, Imamizu H, Osu R, Uno Y, Gomi H, Yoshioka T, Kawato M (1999) Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J Neurophysiol 81: 2140–155

    CAS  PubMed  Google Scholar 

  • Nichols TR (1994) A biomechanical perspective on spinal mechanisms of coordinated muscular action: an architecture principle. Acta Anatomica 151: 1–3

    CAS  PubMed  Google Scholar 

  • Osu R, Kamimura N, Iwasaki H, Nakano E, Harris CM, Wada Y, Kawato M (2004) Optimal impedance control for task achievement in the presence of signal-dependent noise. J Neurophysiol 92: 1199–215

    Article  PubMed  Google Scholar 

  • Paninski L, Shoham S, Fellows MR, Hatsopoulos NG, Donoghue JP (2004) Superlinear population encoding of dynamic hand trajectory in primary motor cortex. J Neurosci 24: 8551–561

    Article  CAS  PubMed  Google Scholar 

  • Pollick FE, Sapiro G (1997) Constant affine velocity predicts the 1/3 power law of planar motion perception and generation. Vis Res 37: 347–53

    Article  CAS  PubMed  Google Scholar 

  • Pollick FE, Maoz U, Handzel AA, Giblin PJ, Sapiro G, Flash T (2008) Three-dimensional arm movements at constant equi-affine speed. Cortex (in press). doi:10.1016/j.cortex.2008.03.010

  • Polyakov F (2001) Analysis of monkey scribbles in the framework of models of planar hand motion. MSc Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_msc.pdf(cited on June 18, 2008)

  • Polyakov F (2006) Motion primitives and invariants in monkey scribbling movements: analysis and mathematical modeling of movement kinematics and neural activities. PhD Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_phd.pdf(cited on May 29, 2008)

  • Polyakov F, Flash T, Abeles M, Ben-Shaul Y, Drori R, Nadasdy Z (2001) Analysis of motion planning and learning in monkey scribbling movements. In: Meulenbrouk R, Steenbergen B (eds) Proceedings of the 10th biennial conference of the International Graphonomics Society. The University of Nijmegen, Nijmegen, The Netherlands. pp 78–3. http://www.wisdom.weizmann.ac.il/~felix/texts/IGS2001.pdf(cited on June 18, 2008)

  • Reina GA, Schwartz AB (2003) Eye–hand coupling during closed-loop drawing: Evidence of shared motor plans?. Hum Mov Sc 22: 137–52

    Article  Google Scholar 

  • Richardson MJ, Flash T (2002) Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis. J Neurosci 22: 8201–211

    CAS  PubMed  Google Scholar 

  • Rohrer B, Hogan N (2003) Avoiding spurious submovement decompositions: a globally optimal algorithm. Biol Cybern 89: 190–99

    Article  PubMed  Google Scholar 

  • Rohrer B, Hogan N (2006) Avoiding spurious submovement decompositions II: a scattershot algorithm. Biol Cybern 94: 409–14

    Article  PubMed  Google Scholar 

  • Sanger TD (2000) Human arm movements described by a low-dimensional superposition of principal components. J Neursci 20: 1066–072

    CAS  Google Scholar 

  • Schaal S, Sternad D (2001) Origins and violations of the two-thirds power law in rhythmic three-dimensional arm movements. Exp Brain Res 136: 60–2

    Article  CAS  PubMed  Google Scholar 

  • Schwartz AB (1992) Motor cortical activity during drawing movements—single-unit activity during sinusoid tracing. J Neurophysiol 68: 528–41

    CAS  PubMed  Google Scholar 

  • Schwartz AB (1994) Direct cortical representation of drawing. Science 265: 540–42

    Article  CAS  PubMed  Google Scholar 

  • Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6: 461–64

    Article  Google Scholar 

  • Scott SH (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5: 532–46

    Article  CAS  PubMed  Google Scholar 

  • Sergio LE, Hamel-Paquet C, Kalaska JF (2005) Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. J Neurophysiol 94: 2353–378

    Article  PubMed  Google Scholar 

  • Shirokov PA, Shirokov AP (1959) Affine differential geometry (in Russian). GIFML, Moscow

    Google Scholar 

  • Soechting JF, Terzuolo CA (1987a) Organization of arm movements. Motion is segmented. Neuroscience 23: 39–1

    Article  CAS  PubMed  Google Scholar 

  • Soechting JF, Terzuolo CA (1987b) Organization of arm movements in three-dimensional space. Wrist motion is piecewise planar. Neuroscience 23: 53–1

    Article  CAS  PubMed  Google Scholar 

  • Sosnik R, Hauptmann B, Karni A, Flash T (2004) When practice leads to co-articulation: the evolution of geometrically defined movement primitives. Exp Brain Res 156: 422–38

    Article  PubMed  Google Scholar 

  • Spivak MA (1999) A comprehensive introduction to differential geometry. Publish or Perish Inc., Berkeley

    Google Scholar 

  • Stark E, Drori R, Asher I, Ben-Shaul Y, Abeles M (2007) Distinct movement parameters are represented by different neurons in the motor cortex. Eur J Neurosci 26: 1055–066

    Article  PubMed  Google Scholar 

  • Sternad D, Schaal S (1999) Segmentation of endpoint trajectories does not imply segmented control. Exp Brain Res 124: 118–36

    Article  CAS  PubMed  Google Scholar 

  • Tanaka H, Krakauer JW, Qian N (2006) An optimization principle for determining movement duration. J Neurophysiol 95: 3875–3886

    Article  PubMed  Google Scholar 

  • Thoroughman KA, Shadmehr R (2000) Learning of action through adaptive combination of motor primitives. Nature 407: 742–47

    Article  CAS  PubMed  Google Scholar 

  • Todd JT, Oomes AH, Koenderink JJ, Kappers AM (2001) On the affine structure of perceptual space. Psychol Sci 12: 191–96

    Article  CAS  PubMed  Google Scholar 

  • Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci 7: 907–15

    Article  CAS  PubMed  Google Scholar 

  • Todorov E, Jordan MI (1998) Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J Neurophysiol 80: 696–14

    CAS  PubMed  Google Scholar 

  • Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–235

    Article  CAS  PubMed  Google Scholar 

  • Torres E, Andersen R (2006) Space-time separation during obstacle-avoidance learning in monkeys. J Neurophysiol 96: 2613–632

    Article  PubMed  Google Scholar 

  • Tresch MC, Saltiel P, Bizzi E (1999) The construction of movement by the spinal cord. Nat Neurosci 2: 162–67

    Article  CAS  PubMed  Google Scholar 

  • Uno Y, Kawato M, Suzuki R (1989) Formation and control of optimal trajectory in human multijoint arm movement—minimum torque-change model. Biol Cybern 61: 89–01

    Article  CAS  PubMed  Google Scholar 

  • Viviani P (1986) Do units of motor action really exist?. In: Heuer H, Fromm C(eds) Generation and modulation of action patterns. Springer, Berlin, pp 201–16

    Google Scholar 

  • Viviani P, Cenzato M (1985) Segmentation and coupling in complex movements. J Exp Psychol Hum Percept Perform 11: 828–45

    Article  CAS  PubMed  Google Scholar 

  • Viviani P, Flash T (1995) Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. J Exp Psychol Hum Percept Perform 21: 32–3

    Article  CAS  PubMed  Google Scholar 

  • Viviani P, Stucchi N (1992) Biological movements look uniform: evidence of motor-perceptual interactions. J Exp Psychol Hum Percept Perform 18: 603–23

    Article  CAS  PubMed  Google Scholar 

  • Wu W, Black MJ, Mumford D, Gao Y, Bienenstock E, Donoghue JP (2004) Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Trans Biomed Eng 51: 933–42

    Article  PubMed  Google Scholar 

  • Zuylen EJ, Gielen CC, Gon Denier JJ (1988) Coordination and inhomogeneous activation of human arm muscles during isometric torques. J Neurophysiol 60: 1523–548

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Felix Polyakov.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Polyakov, F., Stark, E., Drori, R. et al. Parabolic movement primitives and cortical states: merging optimality with geometric invariance. Biol Cybern 100, 159–184 (2009). https://doi.org/10.1007/s00422-008-0287-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-008-0287-0

Keywords

Navigation