Abstract
Previous studies have suggested that several types of rules govern the generation of complex arm movements. One class of rules consists of optimizing an objective function (e.g., maximizing motion smoothness). Another class consists of geometric and kinematic constraints, for instance the coupling between speed and curvature during drawing movements as expressed by the two-thirds power law. It has also been suggested that complex movements are composed of simpler elements or primitives. However, the ability to unify the different rules has remained an open problem. We address this issue by identifying movement paths whose generation according to the two-thirds power law yields maximally smooth trajectories. Using equi-affine differential geometry we derive a mathematical condition which these paths must obey. Among all possible solutions only parabolic paths minimize hand jerk, obey the two-thirds power law and are invariant under equi-affine transformations (which preserve the fit to the two-thirds power law). Affine transformations can be used to generate any parabolic stroke from an arbitrary parabolic template, and a few parabolic strokes may be concatenated to compactly form a complex path. To test the possibility that parabolic elements are used to generate planar movements, we analyze monkeys’ scribbling trajectories. Practiced scribbles are well approximated by long parabolic strokes. Of the motor cortical neurons recorded during scribbling more were related to equi-affine than to Euclidean speed. Unsupervised segmentation of simulta- neously recorded multiple neuron activity yields states related to distinct parabolic elements. We thus suggest that the cortical representation of movements is state-dependent and that parabolic elements are building blocks used by the motor system to generate complex movements.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Abeles M, Bergman H, Gat I, Meilijson I, Seidemann E, Tishby N, Vaadia E (1995) Cortical activity flips among quasi-stationary states. Proc Natl Acad Sci USA 92: 8616–620
Averbeck BB, Chafee MV, Crowe DA, Georgopoulos AP (2002) Parallel processing of serial movements in prefrontal cortex. Proc Natl Acad Sci USA 99: 13172–3177
Averbeck BB, Crowe DA, Chafee MV, Georgopoulos AP (2003) Neural activity in prefrontal cortex during copying geometrical shapes II. Decoding shape segments from neural ensembles. Exp Brain Res 150: 142–53
Ben-Shaul Y, Drori R, Asher I, Stark E, Nadasdy Z, Abeles M (2004) Neuronal activity in motor cortical areas reflects the sequential context of movement. J Neurophysiol 91: 1748–762
Biess A, Liebermann DG, Flash T (2007) Computational model for redundant human 3D pointing movements: integration of independent spatial and temporal motor plans simplifies movement dynamics. J Neurosci 48: 13045–3064
Bizzi E, Mussa-Ivaldi FA, Giszter S (1991) Computations underlying the execution of movement—a biological perspective. Science 253: 287–91
Bright I (2007) Motion planning through optimization. MSc Thesis, Weizmann Institute of Science
Bring J (1996) A geometric approach to compare variables in a regression model. Am Stat 50: 57–2
Brockwell A, Kass RE, Schwartz AB (2007) Statistical signal processing and the motor cortex. Proc IEEE 95: 881–98
Burdet E, Milner TE (1998) Quantization of human motions and learning of accurate movements. Biol Cybern 78: 307–18
Calabi E, Olver PJ, Tannebaum AT (1996) Affine geometry, curve flows, and invariant numerical approximations. Adv Math 124: 154–96
Calabi E, Olver PJ, Shakiban C, Tannenbaum A, Haker S (1998) Differential and numerically invariant signature curves applied to object recognition. Int J Comp Vis 26: 107–35
Carpenter AF, Georgopoulos AP, Pellizzer G (1999) Motor cortical encoding of serial order in a context-recall task. Science 283: 1752–757
Craizer M, Lewiner T, Morvan J-M (2007) Combining points and tangents into parabolic polygons. J Math Imaging Vis 29: 131–40
d’Avella A, Bizzi E (2005) Shared and specific muscle synergies in natural motor behaviors. Proc Natl Acad Sci USA 102: 3076–081
d’Avella A, Saltiel P, Bizzi E (2003) Combinations of muscle synergies in the construction of a natural motor behavior. Nat Neurosci 6: 300–08
d’Avella A, Portone A, Fernandez L, Lacquaniti F (2006) Control of fast-reaching movements by muscle synergy combinations. J Neurosci 26: 7791–810
Dayan E, Casile A, Levit-Binnun N, Giese MA, Hendler T, Flash T (2007) Neural representations of kinematic laws of motion: evidence for action-perception coupling. Proc Natl Acad Sci USA 104: 20582–0587
Dounskaia N (2007) Kinematic invariants during cyclical arm movements. Biol Cybern 96: 147–63
Fishbach A, Roy SA, Bastianen C, Miller LE, Houk JC (2005) Kinematic properties of on-line error corrections in the monkey. Exp Brain Res 164: 442–57
Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 1688–703
Flash T, Henis E (1991) Arm trajectory modifications during reaching towards visual targets. J Cogn Neurosci 3: 220–30
Flash T, Hochner B (2005) Motor primitives in vertebrates and invertebrates. Curr Opin Neurobiol 15: 660–66
Flash T, Handzel AA (2007) Affine differential geometry analysis of human arm movements. Biol Cybern 96: 577–01
Gat I, Tishby N (1993) Statistical modeling of cell assemblies activities in associative cortex of behaving monkeys. In: Hanson SJ, Cowan JD, Giles SL(eds) Neural information processing systems, vol 5. Denver, Colorado, pp 945–53
Gat I, Tishby N, Abeles M (1997) Hidden Markov modelling of simultaneously recorded cells in the associative cortex of behaving monkeys. Netw Comput Neural Syst 8: 297–22
Gelfand I, Fomin S (1963) Calculus of variations. Prentice-Hall, Englewood Cliffs
Giszter SF, Mussa-Ivaldi FA, Bizzi E (1993) Convergent force fields organized in the frog’s spinal cord. J Neurosci 13: 467–91
Giszter S, Patil V, Hart C (2007) Primitives, premotor drives, and pattern generation: a combined computational and neuroethological perspective. Prog Brain Res 165: 323–46
Gribble PL, Ostry DJ (1996) Origins of the power law relation between movement velocity and curvature: modeling the effects of muscle mechanics and limb dynamics. J Neurophysiol 76: 2853–2860
Guggenheimer HW (1977) Differential geometry. Dover, New York
Handzel A, Flash T (1999) Geometric methods in the study of human motor control. Cogn Stud 6: 309–21
Handzel A, Flash T (2001) Affine invariant edge completion with affine geodesics. In: IEEE workshop on variational and level set methods, Vancouver, Canada, pp 97–03
Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394: 780–84
Harris CM, Wolpert DM (2006) The main sequence of saccades optimizes speed-accuracy trade-off. Biol Cybern 95: 21–9
Hart CB, Giszter SF (2004) Modular premotor drives and unit bursts as primitives for frog motor behaviors. J Neurosci 24: 5269–282
Hatsopoulos NG, Paininski L, Donoghue JP (2003) Sequential movement representations based on correlated neuronal activity. Exp Brain Res 149: 478–86
Hatsopoulos NG, Xu Q, Amit Y (2007) Encoding of movement fragments in the motor cortex. J Neurosci 27: 5105–114
Hebb DO (1949) The organization of behavior. Wiley, New York
Hogan N (1984) An organizing principle for a class of voluntary movements. J Neurosci 4: 2745–754
Ivanenko YP, Grasso R, Macellari V, Lacquaniti F (2002) Two-thirds power law in human locomotion: role of ground contact forces. Neuroreport 13: 1171–174
Ivanenko YP, Poppele RE, Lacquaniti F (2004) Five basic muscle activation patterns account for muscle activity during human locomotion. J Physiol 556: 267–82
Ivanenko YP, Cappellini G, Dominici N, Poppele RE, Lacquaniti F. (2005) Coordination of locomotion with voluntary movements in humans. J Neurosci 25: 7238–253
Jackson A, Mavoori J, Fetz EE (2006) Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444: 56–0
Johnson MTV, Coltz JD, Ebner TJ (1999) Encoding of target direction and speed during visual instruction and arm tracking in dorsal premotor and primary motor cortical neurons. Eur J Neurosci 11: 4433–445
Jones LM, Fontanini A, Sadacca BF, Miller P, Katz DB (2007) Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proc Natl Acad Sci USA 104: 18772–8777
Kargo WJ, Giszter SF (2000) Rapid correction of aimed movements by summation of force-field primitives. J Neurosci 20: 409–26
Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954–56
Kording KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10: 319–26
Krebs HI, Aisen MI, Volpe BT, Hogan N (1999) Quantization of continuous arm movements in humans with brain injury. Proc Natl Acad Sci USA 96: 4645–649
Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychol (Amst) 54: 115–30
Levit-Binnun N, Schechtman E, Flash T (2006) On the similarities between the perception and production of elliptical trajectories. Exp Brain Res 172: 533–55
Maoz U (2007) Trajectory formation and units of action, from two- to three-dimensional motion. PhD Thesis, The Hebrew University of Jerusalem
Maoz U, Berthoz A, Flash T (2008) Complex unconstrained three-dimensional arm movement and constant equi-affine speed. J Nurohysiol. doi:10.1152/jn.90702.2008
Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82: 2676–2692
Morasso P (1981) Spatial control of arm movements. Exp Brain Res 42: 223–27
Morasso P, Mussa Ivaldi FA (1982) Trajectory formation and handwriting: a computational model. Biol Cybern 45: 131–42
Mussa-Ivaldi FA, Bizzi E (2000) Motor learning through the combination of primitives. Philos Trans R Soc Lond B Biol Sci 355: 1755–769
Mussa-Ivaldi FA, Solla SA (2004) Neural primitives for motion control. IEEE J Ocean Eng 29: 640–50
Nakano E, Imamizu H, Osu R, Uno Y, Gomi H, Yoshioka T, Kawato M (1999) Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J Neurophysiol 81: 2140–155
Nichols TR (1994) A biomechanical perspective on spinal mechanisms of coordinated muscular action: an architecture principle. Acta Anatomica 151: 1–3
Osu R, Kamimura N, Iwasaki H, Nakano E, Harris CM, Wada Y, Kawato M (2004) Optimal impedance control for task achievement in the presence of signal-dependent noise. J Neurophysiol 92: 1199–215
Paninski L, Shoham S, Fellows MR, Hatsopoulos NG, Donoghue JP (2004) Superlinear population encoding of dynamic hand trajectory in primary motor cortex. J Neurosci 24: 8551–561
Pollick FE, Sapiro G (1997) Constant affine velocity predicts the 1/3 power law of planar motion perception and generation. Vis Res 37: 347–53
Pollick FE, Maoz U, Handzel AA, Giblin PJ, Sapiro G, Flash T (2008) Three-dimensional arm movements at constant equi-affine speed. Cortex (in press). doi:10.1016/j.cortex.2008.03.010
Polyakov F (2001) Analysis of monkey scribbles in the framework of models of planar hand motion. MSc Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_msc.pdf(cited on June 18, 2008)
Polyakov F (2006) Motion primitives and invariants in monkey scribbling movements: analysis and mathematical modeling of movement kinematics and neural activities. PhD Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_phd.pdf(cited on May 29, 2008)
Polyakov F, Flash T, Abeles M, Ben-Shaul Y, Drori R, Nadasdy Z (2001) Analysis of motion planning and learning in monkey scribbling movements. In: Meulenbrouk R, Steenbergen B (eds) Proceedings of the 10th biennial conference of the International Graphonomics Society. The University of Nijmegen, Nijmegen, The Netherlands. pp 78–3. http://www.wisdom.weizmann.ac.il/~felix/texts/IGS2001.pdf(cited on June 18, 2008)
Reina GA, Schwartz AB (2003) Eye–hand coupling during closed-loop drawing: Evidence of shared motor plans?. Hum Mov Sc 22: 137–52
Richardson MJ, Flash T (2002) Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis. J Neurosci 22: 8201–211
Rohrer B, Hogan N (2003) Avoiding spurious submovement decompositions: a globally optimal algorithm. Biol Cybern 89: 190–99
Rohrer B, Hogan N (2006) Avoiding spurious submovement decompositions II: a scattershot algorithm. Biol Cybern 94: 409–14
Sanger TD (2000) Human arm movements described by a low-dimensional superposition of principal components. J Neursci 20: 1066–072
Schaal S, Sternad D (2001) Origins and violations of the two-thirds power law in rhythmic three-dimensional arm movements. Exp Brain Res 136: 60–2
Schwartz AB (1992) Motor cortical activity during drawing movements—single-unit activity during sinusoid tracing. J Neurophysiol 68: 528–41
Schwartz AB (1994) Direct cortical representation of drawing. Science 265: 540–42
Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6: 461–64
Scott SH (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5: 532–46
Sergio LE, Hamel-Paquet C, Kalaska JF (2005) Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. J Neurophysiol 94: 2353–378
Shirokov PA, Shirokov AP (1959) Affine differential geometry (in Russian). GIFML, Moscow
Soechting JF, Terzuolo CA (1987a) Organization of arm movements. Motion is segmented. Neuroscience 23: 39–1
Soechting JF, Terzuolo CA (1987b) Organization of arm movements in three-dimensional space. Wrist motion is piecewise planar. Neuroscience 23: 53–1
Sosnik R, Hauptmann B, Karni A, Flash T (2004) When practice leads to co-articulation: the evolution of geometrically defined movement primitives. Exp Brain Res 156: 422–38
Spivak MA (1999) A comprehensive introduction to differential geometry. Publish or Perish Inc., Berkeley
Stark E, Drori R, Asher I, Ben-Shaul Y, Abeles M (2007) Distinct movement parameters are represented by different neurons in the motor cortex. Eur J Neurosci 26: 1055–066
Sternad D, Schaal S (1999) Segmentation of endpoint trajectories does not imply segmented control. Exp Brain Res 124: 118–36
Tanaka H, Krakauer JW, Qian N (2006) An optimization principle for determining movement duration. J Neurophysiol 95: 3875–3886
Thoroughman KA, Shadmehr R (2000) Learning of action through adaptive combination of motor primitives. Nature 407: 742–47
Todd JT, Oomes AH, Koenderink JJ, Kappers AM (2001) On the affine structure of perceptual space. Psychol Sci 12: 191–96
Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci 7: 907–15
Todorov E, Jordan MI (1998) Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J Neurophysiol 80: 696–14
Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–235
Torres E, Andersen R (2006) Space-time separation during obstacle-avoidance learning in monkeys. J Neurophysiol 96: 2613–632
Tresch MC, Saltiel P, Bizzi E (1999) The construction of movement by the spinal cord. Nat Neurosci 2: 162–67
Uno Y, Kawato M, Suzuki R (1989) Formation and control of optimal trajectory in human multijoint arm movement—minimum torque-change model. Biol Cybern 61: 89–01
Viviani P (1986) Do units of motor action really exist?. In: Heuer H, Fromm C(eds) Generation and modulation of action patterns. Springer, Berlin, pp 201–16
Viviani P, Cenzato M (1985) Segmentation and coupling in complex movements. J Exp Psychol Hum Percept Perform 11: 828–45
Viviani P, Flash T (1995) Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. J Exp Psychol Hum Percept Perform 21: 32–3
Viviani P, Stucchi N (1992) Biological movements look uniform: evidence of motor-perceptual interactions. J Exp Psychol Hum Percept Perform 18: 603–23
Wu W, Black MJ, Mumford D, Gao Y, Bienenstock E, Donoghue JP (2004) Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Trans Biomed Eng 51: 933–42
Zuylen EJ, Gielen CC, Gon Denier JJ (1988) Coordination and inhomogeneous activation of human arm muscles during isometric torques. J Neurophysiol 60: 1523–548
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Polyakov, F., Stark, E., Drori, R. et al. Parabolic movement primitives and cortical states: merging optimality with geometric invariance. Biol Cybern 100, 159–184 (2009). https://doi.org/10.1007/s00422-008-0287-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-008-0287-0