Abstract
Most conventional robots rely on controlling the location of the center of pressure to maintain balance, relying mainly on foot pressure sensors for information. By contrast, humans rely on sensory data from multiple sources, including proprioceptive, visual, and vestibular sources. Several models have been developed to explain how humans reconcile information from disparate sources to form a stable sense of balance. These models may be useful for developing robots that are able to maintain dynamic balance more readily using multiple sensory sources. Since these information sources may conflict, reliance by the nervous system on any one channel can lead to ambiguity in the system state. In humans, experiments that create conflicts between different sensory channels by moving the visual field or the support surface indicate that sensory information is adaptively reweighted. Unreliable information is rapidly down-weighted, then gradually up-weighted when it becomes valid again. Human balance can also be studied by building robots that model features of human bodies and testing them under similar experimental conditions. We implement a sensory reweighting model based on an adaptive Kalman filter in a bipedal robot, and subject it to sensory tests similar to those used on human subjects. Unlike other implementations of sensory reweighting in robots, our implementation includes vision, by using optic flow to calculate forward rotation using a camera (visual modality), as well as a three-axis gyro to represent the vestibular system (non-visual modality), and foot pressure sensors (proprioceptive modality). Our model estimates measurement noise in real time, which is then used to recompute the Kalman gain on each iteration, improving the ability of the robot to dynamically balance. We observe that we can duplicate many important features of postural sway in humans, including automatic sensory reweighting, effects, constant phase with respect to amplitude, and a temporal asymmetry in the reweighting gains.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Carew B, BTlanger P (1973) Identification of optimum filter steady-state gain for systems with unknown noise covariances. IEEE Trans Autom Control 18(6): 582–587
Carver S, Kiemel T, van der Kooij H, Jeka JJ (2005) Comparing internal models of the dynamics of the visual environment. Biol Cybern 92(3): 147–163
Carver T, Kiemel S, Jeka J (2006) Modelling the dynamics of sensory reweighting. Biol Cybern 95(2): 123–134
Clark S, Riley MA (2007) Multisensory information for postural control: sway-referencing gain shapes center of pressure variability and temporal dynamics. Exp Brain Res 176(2): 299–310
Day BL, Cauquil AS, Bartolomei L, Pastor MA, Lyon IN (1997) Human body-segment tilts induced by galvanic stimulation: a vestibularly driven balance protection mechanism. J Physiol 500(3): 661–672
Dokka K, Kenyon RV, Keshner EA, Kording KP (2010) Self versus environment motion in postural control. PLoS Comput Biol 6(2):e1000,680. doi:10.1371/journal.pcbi.1000680
Drécourt JP, Madsen H, Rosbjerg D (2006) Bias aware kalman filters: comparison and improvements. Adv Water Resour 29(5): 707–718
Friedland B (1969) Treatment of bias in recursive filtering. IEEE Trans Autom Control 14(4): 359–367
Gibson JJ (1986) The ecological approach to visual perception, new edition edn. Psychology Press, New York
Hirai K, Hirose M, Haikawa Y, Takenaka T (1998) The development of the honda humanoid robot. In: Proceedings of internatioanl conference on robotics and automation, Leuven, pp 1321–1326
Horak FB, Macpherson JM (1996) Postural orientation and equilibrium. Oxford University Press, New York
Jeka JJ, Allison L, Kiemel T (2010) The dynamics of visual reweighting in healthy and fall-prone older adults. J Motor Behav 42(4): 197–208
Kalman R (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 82: 35–45
Kiemel T, Oie KS, Jeka J (2002) Multisensor fusion and the stochastic structure of postural sway. Biol Cybern 87(4): 262–277
Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427(6971):244–247. doi:10.1038/nature02169, http://dx.doi.org/10.1038/nature02169
Körding KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10(7):319–326. doi:10.1016/j.tics.2006.05.003, http://www.sciencedirect.com/science/article/pii/S1364661306001276 (special issue: Probabilistic models of cognition)
Lee D (1980) The optic flow field: the foundation of vision. Philos Trans R Soc Lond 290(1038): 169–179
Lewis MA (2002) Detecting surface features during locomotion using optic flow. In: Proceeding of international conference on robotics and automation, Fukuoka
Lucas B, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of image understanding workshop, pp 121–130
Mahboobin A, Loughlin PJ, Redfern MS, Anderson SO, Atkeson CG, Hodgkins JK (2008) Sensory adaptation in balance control: lessons for biomimetic robotic bipeds. Neural Netw 21(4): 621–627
Mehra RK (1970) On the identification of variances and adaptive kalman filtering. IEEE Trans Autom Control 15(2): 175–184
Mergner T, Maurer C, Peterka R (2003) A multisensory posture control model of human upright stance. In: Prablanc C, Pelisson YRD (eds) Neural control of space coding and action production, vol 142, Prog Brain Res, Elsevier, Amsterdam, pp 189–201
Mergner T, Schweigart G, Fennell L (2009) Vestibular humanoid postural control. Journal of Physiology-Paris 103(3-5):178–194. doi:10.1016/j.jphysparis.2009.08.002, http://www.sciencedirect.com/science/article/pii/S0928425709000436 (neurorobotics)
Myers KA, Tapley BD (1976) Adaptive sequential estimation with unknown noise statistics. IEEE Trans Autom Control 21(4): 520–523
Oie K, Carver S, Kiemel T, Barela J, Jeka J (2005) The dynamics of sensory reweighting: a temporal asymmetry. Gait Posture 21(1): S29
Oie KS, Kiemel T, Jeka J (2002) Mulisensory fusion: simultaneous re-weighting of vision and touch for the control of human posture. Cogn Brain Res 14(1): 164–167
Oussalah M, Schutter JD (2000) Adaptive kalman filter for noise identification. In: Proceedings of the international conference on noise and vibration engineering, pp 1225–1232
Peterka R (2002) Sensorimotor integration in human postural control. J Neurophysiol 88(3): 1097–1118
Peterka R, Benolken M (1995) Role of somatosensory and vestibular cues in attenuating visually induced postural sway. Exp Brain Res 105(1): 101–110
Peterka RJ, Loughlin PJ (2004) Dynamic regulation of sensorimotor integration in human postural control. J Neurophysiol 91(1): 410–423
Prokop T, Schubert M, Berger W (1997) Visual influence on human locomotion: modulation to changes in optic flow. Exp Brain Res 114(1): 63–70
Purves D (2007) Neuroscience. Sinauer Associates, Inc, Sunderland
Sakagami Y, Watanabe R, Aoyama C, Matsunaga S, Higaki N, Fujimura K (2002) The intelligent asimo: system overview and integration. In: IEEE/RSJ international conference on intelligent robots and systems, Lausanne
Shöner G (1991) Dynamic theory of action–perception patterns: the “moving room” paradigm. Biol Cybern 64(6): 455–462
van der Kooij H, Jacobs R, Koopman B, van der Helm F (2001) An adaptive model of sensory integration in a dynamic environment applied to human stance control. Biol Cybern 84(2): 103–115
Vukobratovic M, Borovac B (2004) Zero-movement point—thirty-five years of it’s life. Int J Humanoid Robot 1(1): 157–173
Warren WH, Jr., Kay BA, Zosh WD, Duchon AP, Sahuc S (2001) Optic flow is used to control human walking. Nat Neurosci 4(2): 213–216
Webb B (2001) Can robots make good models of biological behaviour. Behav Brain Sci 24: 1033–1050
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Klein, T.J., Jeka, J., Kiemel, T. et al. Navigating sensory conflict in dynamic environments using adaptive state estimation. Biol Cybern 105, 291–304 (2011). https://doi.org/10.1007/s00422-011-0466-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-011-0466-2