Abstract
This paper proposes a method for recognizing compound trajectories. Given a library of pre-learned movements described using dynamic movement primitives, our approach is able to break down an observed trajectory into its individual components, each of which is a segment of one of the movements in the library. We build on previous work that uses critical points for movement recognition and prediction, and extend it to handle trajectories comprising multiple segments from possibly different movements. Our approach assumes that each segment in the observed trajectory is either the initial segment of a new primitive or the continuation of the previous segment. Then, given a partial trajectory, our method is able to predict the most likely next target—i.e., the end-point of the movement currently being executed, if the latter is executed to the end. By using an effective search tree, our approach is able to run at execution time and provide an efficient way for action recognition and prediction, which has applications in human-robot interaction scenarios. We validate our approach both in simulation and in a human-robot interaction scenario involving the Baxter robot.
This work was partially supported by national funds through FCT, Fundação para a Ciência e a Tecnologia, under projects UIDB/50021/2020 and PTDC/CCI-COM/7203/2020. The first author acknowledges the Ph.D. grant from the Global Platform for Syrian Students. The authors thank Miguel Vasco for useful discussions and revisions of the document.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
\(C_t\) is a time-dependent weighting factor. In our experiments, we used \(C_t=1\).
References
Black, M.J., Jepson, A.D.: A probabilistic framework for matching temporal trajectories: condensation-based recognition of gestures and expressions. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 909–924. Springer, Heidelberg (1998). https://doi.org/10.1007/BFb0055712
Black, M., Jepson, A.: Recognizing temporal trajectories using the condensation algorithm. In: Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 16–21 (1998)
Dermy, O., Paraschos, A., Ewerton, M., Peters, J., Charpillet, F., Ivaldi, S.: Prediction of intention during interaction with iCub with probabilistic movement primitives. Front. Robot. AI 4, 45 (2017)
Ijspeert, A., Nakanishi, J., Hoffmann, H., Pastor, P., Schaal, S.: Dynamical movement primitives Learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)
Kelso, J.: Dynamic Patterns: The Self-Organization of Brain and Behavior. MIT Press, Cambridge (1995)
Kordia, A., Melo, F.: An end-to-end approach for learning and generating complex robot motions from demonstration. In: Proceedings of the 16th IEEE International Conference on Control, Automation, Robotics and Vision, pp. 1008–1014 (2020)
Kordia, A., Melo, F.: Movement recognition and prediction using DMPs. In: Proceedings of the 2021 IEEE International Conference on Robotics and Automation (2021)
Kulvicius, T., Ning, K., Tamosiunaite, M., Worgötter, F.: Joining movement sequences: modified dynamic movement primitives for robotics applications exemplified on handwriting. IEEE Trans. Robot. 28(1), 145–157 (2012)
Lee, D., Ott, C., Nakamura, Y.: Mimetic communication model with compliant physical contact in human-humanoid interaction. Int. J. Robot. Res. 29(13), 1684–1704 (2010)
Loshchilov, I.: A computationally efficient limited memory CMA-ES for large scale optimization. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, pp. 397–404 (2014)
Ma, S., Zhang, J., Ikizler-Cinbis, N., Sclaroff, S.: Action recognition and localization by hierarchical space-time segments. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2744–2751 (2013)
Maeda, G., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., Peters, J.: Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton. Robot. 41(3), 593–612 (2017)
Meier, F., Theodorou, E., Schaal, S.: Movement segmentation and recognition for imitation learning. In: Proceedings of the 15th International Conference on Artificial Intelligence and Statistics, pp. 761–769 (2012)
Mulling, K., Kober, J., Peters, J.: Learning table tennis with a mixture of motor primitives. In: Proceedings of the 2010 IEEE-RAS International Conference on Humanoid Robots, pp. 411–416 (2010)
Nemec, B., Tamosiunaite, M., Woergoetter, F., Ude, A.: Task adaptation through exploration and action sequencing. In: Proceedings of the 9th IEEE-RAS International Conference on Humanoid Robots, pp. 610–616 (2009)
Oliver, N., Rosario, B., Pentland, A.: A Bayesian computer vision system for modeling human interactions. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 831–843 (2000)
Stulp, F., Sigaud, O.: Path integral policy improvement with covariance matrix adaptation. In: Proceedings of the 29th International Conference on Machine Learning, pp. 1547–1554 (2012)
Stulp, F., Sigaud, O.: Robot skill learning: from reinforcement learning to evolution strategies. PALADYN J. Behav. Robot. 4(1), 49–61 (2013)
Tanaka, Y., Kinugawa, J., Sugahara, Y., Kosuge, K.: Motion planning with worker’s trajectory prediction for assembly task partner robot. In: Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1525–1532 (2012)
Yoon, H., Soh, J., Bae, Y., Yang, H.: Hand gesture recognition using combined features of location, angle and velocity. Pattern Recogn. 34(7), 1491–1501 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kordia, A.H., Melo, F.S. (2021). Compound Movement Recognition Using Dynamic Movement Primitives. In: Marreiros, G., Melo, F.S., Lau, N., Lopes Cardoso, H., Reis, L.P. (eds) Progress in Artificial Intelligence. EPIA 2021. Lecture Notes in Computer Science(), vol 12981. Springer, Cham. https://doi.org/10.1007/978-3-030-86230-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-86230-5_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86229-9
Online ISBN: 978-3-030-86230-5
eBook Packages: Computer ScienceComputer Science (R0)