Abstract
We have previously proposed an optimal trajectory and control theory for continuous movements, such as reaching or cursive handwriting. According to Marr's three-level description of brain function, our theory can be summarized as follows: (1) The computational theory is the minimum torque-change model; (2) the intermediate representation of a pattern is given as a set of via-points extracted from an example pattern; and (3) algorithm and hardware are provided by FIRM, a neural network that can generate and control minimum torque-change trajectories. In this paper, we propose a computational theory for movement pattern recognition that is based on our theory for optimal movement pattern generation. The three levels of the description of brain function in the recognition theory are tightly coupled with those for pattern generation. In recognition, the generation process and the recognition process are actually two flows of information in opposite directions within a single functional unit. In our theory, if the input movement trajectory data are identical to the optimal movement pattern reconstructed from an intermediate representation of some symbol, the input data are recognized as that symbol. If an error exists between the movement trajectory data and the generated trajectory, the putative symbol is corrected, and the generation is repeated. In particular, we present concrete computational procedures for the recognition of connected cursive handwritten characters, as well as for the estimation of phonemic timing in natural speech. Our most important contribution is to demonstrate the computational realizability for the ‘motor theory of movement pattern perception’: the movement-pattern recognition process can be realized by actively recruiting the movementpattern formation process. The way in which the formation process is utilized in pattern recognition in our theory suggests a duality between movement pattern formation and movement pattern perception.
Similar content being viewed by others
References
Babcock MK, Freyd JJ (1988) Perception of dynamic information in static handwritten forms. Am J Psychol 101:111–130
Freyd JJ (1983) Representing the dynamics of a static form. Memory Cognition 11:342–346
Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5:1688–1703
Haken H, Kelso JAS, Fuchs A, Pandya A (1990) Dynamic pattern recognition of coordinated biological motion. Neural Networks 3:395–401
Hirayama M, Vatikiotis-Bateson E, Kawato M (1993a) Physiologically-based speech synthesis using neural networks. IEICE TransFundamentals E76-A:1898–1910
Hirayama M, Vatikiotis-Bateson E, Honda K, Koike Y, Kawato M (1993b) Physiologically-based speech synthesis. Neural Inf Proc Syst 5:658–665
Hirayama M, Vatikiotis-Bateson E, Kawato M (1994) Inverse dynamics of speech motor control. Adv Neural Inf Proc Syst 6:1043–1050
Kawato M (1989) Motor theory of speech perception revisited from the minimum torque-change neural network model. 8th Symposium on Future Electron Devices Tokyo, Japan, pp. 141–150
Kawato M (1994) Trajectory formation in arm movements: minimization principles and procedures. In: Zelaznik HN (eds) Advances in motor learning and control. Human Kinetics Publishers, Champaign, (in press)
Kawato M, Maeda Y, Uno Y, Suzuki R (1990) Trajectory formation of arm movement by a cascade neural network model based on minimum torque-change criterion. Biol Cybern 62:275–288
Liberman AM, Mattingly IG (1985) The motor theory of speech perception revised. Cognition 21:1–36
Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74:431–461
Marr D (1982) Vision. Freeman, New York
Papcun J, Hochberg J, Thomas TR, Laroche T, Zacks J, Levy S (1992) Inferring articulation and recognition gestures from acoustics with a neural network trained on x-ray microbeam data. J Acoustic Soc Am 92(2):688–700
Shirai K, Kobayashi T (1991) Estimation of articulatory motion using neural networks. Phonetics 19:379–385
Uno Y, Kawato M, Suzuki R (1989a) Formation and control of optimal trajectory in human arm movement — minimum torque-change model. Biol Cybern 61:89–101
Uno Y, Suzuki R, Kawato M (1989b) Minimum muscle-tension-change model which reproduces human arm movement. Proceedings of the 4th Symposium on Biological and Physiological Engineering, pp 229–302 (in Japanese)
Wada Y, Kawato M (1993) A neural network model for arm trajectory formation using forward and inverse dynamics models. Neural Networks 6:919–932
Wada Y, Kawato M (1995) A theory for cursive handwriting based on the minimization principle. Biol Cybern 73:3–13
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Wada, Y., Koike, Y., Vatikiotis-Bateson, E. et al. A computational theory for movement pattern recognition based on optimal movement pattern generation. Biol. Cybern. 73, 15–25 (1995). https://doi.org/10.1007/BF00199052
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00199052