Skip to main content
Springer Nature Link
Log in

Skill Memory in Biped Locomotion

Using Perceptual Information to Predict Task Outcome

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Robots must be able to adapt their motor behavior to unexpected situations in order to safely move among humans. A necessary step is to be able to predict failures, which result in behavior abnormalities and may cause irrecoverable damage to the robot and its surroundings, i.e. humans. In this paper we build a predictive model of sensor traces that enables early failure detection by means of a skill memory. Specifically, we propose an architecture based on a biped locomotion solution with improved robustness due to sensory feedback, and extend the concept of Associative Skill Memories (ASM) to periodic movements by introducing several mechanisms into the training workflow, such as linear interpolation and regression into a Dynamical Motion Primitive (DMP) system such that representation becomes time invariant and easily parameterizable. The failure detection mechanism applies statistical tests to determine the optimal operating conditions. Both training and failure testing were conducted on a DARwIn-OP inside a simulation environment to assess and validate the failure detection system proposed. Results show that the system performance in terms of the compromise between sensitivity and specificity is similar with and without the proposed mechanism, while achieving a significant data size reduction due to the periodic approach taken.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. André, J., Santos, C., Costa, L.: Path integral learning of multidimensional movement trajectories. In: Proceedings of the International Conference of Numerical Analysis and Applied Mathematics 2013 (ICNAAM), p 2013. Rhodes, Greece (2013)

  2. Aoi, S., Ogihara, N., Funato, T., Sugimoto, Y., Tsuchiya, K.: Evaluating functional roles of phase resetting in generation of adaptive human bipedal walking with a physiologically-based model of the spinal pattern generator. Biol. Cybern. 102(5), 373–387 (2010)

    Article  Google Scholar 

  3. Chen, M., Zheng, A., Lloyd, J., Jordan, M., Brewer, E.: Failure diagnosis using decision trees. In: Proceedings of the 1st International Conference on Autonomic Computing (ICAC 2004) (IEEE, 2004), pp. 36–43 (2004)

  4. Christensen, A.L.: Fault Detection in Autonomous Robots. Phd, Université Libre de Bruxelles (2008)

  5. Dev Anand, M., Selvaraj, T., Kumanan, S.: Fault detection and fault tolerance methods for industrial robot manipulators based on hybrid intelligent approach. Adv. Prod. Eng. Manag. 7(4), 225–236 (2012)

    Google Scholar 

  6. Hobbelen, D., Wisse, M.: A disturbance rejection measure for limit cycle walkers: The gait sensitivity norm. IEEE Trans. Robot. Autom. 23(6), 1213–1224 (2007)

    Article  Google Scholar 

  7. Hohn, O., Gerth, W.: Probabilistic balance monitoring for bipedal robots. Int. J. Robot. Res. 28(2), 245–256 (2009)

    Article  Google Scholar 

  8. Ijspeert, A.J., Nakanishi, J., Hoffmann, H., Pastor, P., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–73 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  9. Ijspeert, A.J., Nakanishi, J., Schaal, S.: Learning Attractor Landscapes for Learning Motor Primitives. Advances in Neural Information Processing Systems (15), 1523–1530 (2003)

  10. Kalyanakrishnan, S., Goswami, A.: Learning to predict humanoid fall. Int. J. Humanoid Robot. 8(2), 245–273 (2011)

    Article  Google Scholar 

  11. Karssen, J.G.D., Wisse, M.: Fall detection of two-legged walking robots using multi-way principal components analysis. Int. J. Humanoid Robot. 7(1), 73–93 (2010)

    Article  Google Scholar 

  12. Kim, J., Kim, Y., Lee, J.: A machine learning approach to falling detection and avoidance for Biped Robots. In: SICE Annual Conference, pp. 562–567 (2011)

  13. Kunihiro, O., Koji, T., Yasuo, K.: Falling motion control for humanoid robots while walking. In: 7th IEEE-RAS International Conference on Humanoid Robotics (Humanoids 2007), pp. 306–311 (2007)

  14. Matos, V., Santos, C.P.: Central Pattern Generators with Phase Regulation for the Control of Humanoid Locomotion , IEEE-RAS International Conference on Humanoid Robots. Osaka, Japan (2012)

  15. Ogata, K., Terada, K., Kuniyoshi, Y.: Real-time selection and generation of fall damage reduction actions for humanoid robots. In: 7th IEEE-RAS International Conference on Humanoid Robotics (Humanoids 2008), pp. 233–238 (2008)

  16. Olson, D., Delen, D.: Advanced Data Mining Techniques. Springer-Verlag (2008)

  17. Owaki, D., Morikawa, L., Ishiguro, A.: Listen to body’s message: Quadruped robot that fully exploits physical interaction between legs. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 1950–1955. Ieee, Vilamoura, Portugal (2012)

  18. Wieber, P.-B.: Viability and predictive control for safe locomotion. In: 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1103–1108 (2008)

  19. Pastor, P., Hoffmann, H., Asfour, T., Schaal, S.: Learning and generalization of motor skills by learning from demonstration. 2009 IEEE International Conference on Robotics and Automation, 763–768 (2009)

  20. Pastor, P., Kalakrishnan, M., Chitta, S., Theodorou, E., Schaal, S.: Skill learning and task outcome prediction for manipulation. 2011 IEEE International Conference on Robotics and Automation, 3828–3834 (2011)

  21. Pastor, P., Kalakrishnan, M., Meier, F., Stulp, F., Buchli, J., Theodorou, E., Schaal, S.: From dynamic movement primitives to associative skill memories. Robot. Auton. Syst. 61(4), 351–361 (2013)

    Article  Google Scholar 

  22. Pastor, P., Kalakrishnan, M., Righetti, L., Schaal, S.: Towards Associative Skill Memories. In: 12th IEEE-RAS International Conference on Humanoid Robotics (Humanoids), pp 309–315, Osaka, Japan (2012)

  23. Pastor, P., Righetti, L., Kalakrishnan, M., Schaal, S.: Online movement adaptation based on previous sensor experiences. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2011)

  24. Plagemann, C., Stachniss, C., Burgard, W.: Efficient failure detection for mobile robots using mixed-abstraction particle filters. In: European Robotics Symposium 2006, pp. 93–107 (2006)

  25. Renner, R., Behnke, S.: Instability detection and fall avoidance for a humanoid using attitude sensors and reflexes. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2967–2973 (2006)

  26. ROBOTIS: ROBOTIS DARWIN-OP e-Manual v1.23.00. http://support.robotis.com/en/product/darwin-op.htm (2014)

  27. Santos, C.P., Matos, V.: CPG modulation for navigation and omnidirectional quadruped locomotion. Robot. Auton. Syst. 60(6), 912–927 (2012)

    Article  Google Scholar 

  28. Ruiz-del Solar, J., Moya, J., Parra-Tsunekawa, I.: Fall detection and management in biped humanoid robots. Proc. IEEE Int Conf. Robot. Autom. (ICRA 2007) 2, 3323–3328 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Industrial Electronics, University of Minho, Braga, Portugal

    João André & Cristina Santos

  2. Department of Production and System, University of Minho, Braga, Portugal

    Lino Costa

Authors
  1. João André
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Cristina Santos
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Lino Costa
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to João André.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

André, J., Santos, C. & Costa, L. Skill Memory in Biped Locomotion. J Intell Robot Syst 82, 379–397 (2016). https://doi.org/10.1007/s10846-015-0197-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-015-0197-z

Keywords