Skip to main content

Learning to Balance While Reaching: A Cerebellar-Based Control Architecture for a Self-balancing Robot

  • Conference paper
  • First Online:
Biomimetic and Biohybrid Systems (Living Machines 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9793))

Included in the following conference series:

  • 2627 Accesses

Abstract

In nature, Anticipatory Postural Adjustments (APAs) are actions that precede predictable disturbances with the goal of maintaining a stable body posture. Neither the structure of the computations that enable APAs are known nor adaptive APAs have been exploited in robot control. Here we propose a computational architecture for the acquisition of adaptive APAs based on current theories about the involvement of the cerebellum in predictive motor control. The architecture is applied to a simulated self-balancing robot (SBR) mounting a moveable arm, whose actuation induces a perturbation of the robot balance that can be counteracted by an APA. The architecture comprises both reactive (feedback) and anticipatory-adaptive (feed-forward) layers. The reactive layer consists of a cascade-PID controller and the adaptive one includes cerebellar-based modules that supply the feedback layer with predictive signals. We show that such architecture succeeds in acquiring functional APAs, thus demonstrating in a simulated robot an adaptive control strategy for the cancellation of a self-induced disturbance grounded in animal motor control. These results also provide a hypothesis for the implementation of APAs in nature that could inform further experimental research.

Research supported by supported by socSMC-641321—H2020-FETPROACT-2014.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chan, R.P.M., Stol, K.a, Halkyard, C.R.: Review of modelling and control of two-wheeled robots. Annu. Rev. Control 37(1), 89–103 (2013)

    Article  Google Scholar 

  2. Massion, J.: Movement, posture and equilibrium: Interaction and coordination. Prog. Neurobiol. 38(1), 35–56 (1992)

    Article  Google Scholar 

  3. Horak, F.B., Diener, H.C.: Cerebellar control of postural scaling and central set in stance. J. Neurophysiol. 72(2), 479–493 (1994)

    Google Scholar 

  4. Maffei, G., Herreros, I., Sánchez-Fibla, M., Verschure, P.F.: Acquisition of anticipatory postural adjustment through cerebellar learning in a mobile robot. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F., Prescott, T.J. (eds.) Living Machines 2013. LNCS, vol. 8064, pp. 399–401. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  5. Marr, D.: A theory of cerebellar cortex. J. Physiol. 202(2), 437–470 (1969)

    Article  Google Scholar 

  6. Albus, J.S.: A theory of cerebellar function. Math. Biosci. 10(1–2), 25–61 (1971)

    Article  Google Scholar 

  7. Dean, P., Porrill, J., Ekerot, C.-F., Jörntell, H.: The cerebellar microcircuit as an adaptive filter: experimental and computational evidence. Nat. Rev. Neurosci. 11(1), 30–43 (2010)

    Article  Google Scholar 

  8. Albus, J.: A new approach to manipulator control: The cerebellar model articulation controller (CMAC). J. Dyn. Syst. Meas. Control 97(3), 220–227 (1975)

    Article  MATH  Google Scholar 

  9. Li, C., Li, F., Wang, S., Dai, F., Bai, Y., Gao, X., Kejie, L.: Dynamic adaptive equilibrium control for a self-stabilizing robot. In: 2010 IEEE International Conference on Robotics and Biomimetics, ROBIO 2010, pp. 609–614 (2010)

    Google Scholar 

  10. Chiu, C.H., Peng, Y.F.: Design and implement of the self-dynamic controller for two-wheel transporter. In: IEEE International Conference on Fuzzy Systems, pp. 480–483 (2006)

    Google Scholar 

  11. Ruan, X., Chen, J.: On-line NNAC for two-wheeled self-balancing robot based on feedback-error-learning. In: Proceedings - 2010 2nd International Workshop on Intelligent Systems and Applications, ISA 2010 (2010)

    Google Scholar 

  12. Tanaka, Y., Ohata, Y., Kawamoto, T., Hirata, Y.: Adaptive control of 2-wheeled balancing robot by cerebellar neuronal network model. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2010, pp. 1589–1592 (2010)

    Google Scholar 

  13. Gao, J.H., Parsons, L.M., Bower, J.M., Xiong, J., Li, J., Fox, P.T.: Cerebellum implicated in sensory acquisition and discrimination rather than motor control. Science 272, 545–547 (1996)

    Article  Google Scholar 

  14. Miall, R.C., Wolpert, D.M.: Forward models for physiological motor control. Neural Netw. 9(8), 1265–1279 (1996)

    Article  MATH  Google Scholar 

  15. Kawato, M., Furukawa, K., Suzuki, R.: A hierarchical neural-network model for control and learning of voluntary movement. Biol. Cybern. 57(3), 169–185 (1987)

    Article  MATH  Google Scholar 

  16. Astrom, K.J., Murray, R.M.: Feedback Systems: An Introduction for Scientists and Engineers (2012)

    Google Scholar 

  17. Herreros, I., Maffei, G., Brandi, S., Sanchez-Fibla, M., Verschure, P.F.M.J.: Speed generalization capabilities of a cerebellar model on a rapid navigation task. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 363–368 (2013)

    Google Scholar 

  18. Fujita, M.: Adaptive filter model of the cerebellum. Biol. Cybern. 45(3), 195–206 (1982)

    Article  MATH  Google Scholar 

  19. Widrow, B., Lehr, M.A., Beaufays, F., Wan, E., Bilello, M.: Adaptive signal processing. In: Proceedings of the World Conference on Neural Networks, p. 11 (1993)

    Google Scholar 

  20. Herreros, I., Verschure, P.F.M.J.: Nucleo-olivary inhibition balances the interaction between the reactive and adaptive layers in motor control. Neural Netw. 47, 64–71 (2013)

    Article  Google Scholar 

  21. Wolpert, D.M., Kawato, M.: Multiple paired forward and inverse models for motor control. Neural Netw. 11, 1317–1329 (1998)

    Article  Google Scholar 

Download references

Acknowledgements

The research leading to these results has received funding from the European Commission’s Horizon 2020 socSMC project (under agreement number: socSMC-641321H2020-FETPROACT-2014) and by the European Research Council’s CDAC project: (ERC-2013-ADG 341196).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ivan Herreros .

Editor information

Editors and Affiliations

Appendix

Appendix

See Table 1.

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Ruck, M., Herreros, I., Maffei, G., Sánchez-Fibla, M., Verschure, P. (2016). Learning to Balance While Reaching: A Cerebellar-Based Control Architecture for a Self-balancing Robot. In: Lepora, N., Mura, A., Mangan, M., Verschure, P., Desmulliez, M., Prescott, T. (eds) Biomimetic and Biohybrid Systems. Living Machines 2016. Lecture Notes in Computer Science(), vol 9793. Springer, Cham. https://doi.org/10.1007/978-3-319-42417-0_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42417-0_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42416-3

  • Online ISBN: 978-3-319-42417-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics