Abstract
In this paper, we describe the implementation of a closed-loop control architecture on a bio-hybrid robotic system. The control loop uses the spiking activity from two motion-sensitive H1-cells recorded in both halves of the blowfly’s brain as visual feedback signals that are sent to an ARM processor, programmed to establish a brain machine interface. The resulting output controls the movements of the robot which, in turn, generates optic flow that modifies the activity of the H1-cells. Instead of being inhibited by front-to-back optic flow would the robot move forward in a straight line, the closed-loop system autonomously produces an oscillatory trajectory, alternatingly stimulating both H1-cells with back-to-front optic flow. The spike rate information of each cell is then used to control the speed of each robot wheel, on average driving the robot in the forward direction. Our extracellular recordings from the two cells show similar spike rate oscillation frequencies and amplitude, but opposite phases. From our experiments we derive parameters relevant for the future implementation of collision avoidance capabilities. Finally, we discuss a control algorithm that combines positive and negative feedback to drive the robot.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References.
Bomphrey, R.J., Walker, S.M., Taylor, G.K.: The Typical Flight Performance of Blowflies: Measuring the Normal Performance Envelope of Calliphora vicina Using a Novel Corner-Cube Arena. PLoS One 4, e7852 (2009)
Hengstenberg, R.: Gaze control in the blowfly Calliphora: a multisensory, two-stage integration process. Semin. Neurosci. 3, 19–29 (1991)
Lindemann, J.P., Weiss, H., Möller, R., Egelhaaf, M.: Saccadic flight strategy facilitates collision avoidance: closed-loop performance of a cyberfly. Biol. Cybern. 98, 213–227 (2008)
Ejaz, N., Peterson, K.D., Krapp, H.G.: An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces. J. Vis. Exp. (2011)
Lewen, G.D., Bialek, W., de Ruyter van Steveninck, R.R.: Neural coding of naturalistic motion stimuli. Netw. Bristol. Engl. 12, 317–329 (2008)
Minegishi, R., Takashima, A., Kurabayashi, D., Kanzaki, R.: Construction of a brain–machine hybrid system to evaluate adaptability of an insect. Robot. Auton. Syst. 60, 692–699 (2012)
Reid, R. Harrison, R.J.K.: Wireless Telemetry of In-Flight Collision Avoidance Neural Signals in Insects 26 (2010)
Maimon, G., Straw, A.D., Dickinson, M.H.: Active flight increases the gain of visual motion processing in Drosophila. Nat. Neurosci. 13, 393–399 (2010)
Huston, S.J., Krapp, H.G.: Nonlinear Integration of Visual and Haltere Inputs in Fly Neck Motor Neurons. J. Neurosci. 29, 13097–13105 (2009)
Huang, J.V., Krapp, H.G.: Miniaturized electrophysiology platform for fly-robot interface to study multisensory integration. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F., Prescott, T.J. (eds.) Living Machines 2013. LNCS, vol. 8064, pp. 119–130. Springer, Heidelberg (2013)
Huang, J.V., Krapp, H.G.: A predictive model for closed-loop collision avoidance in a fly-robotic interface. In: Duff, A., Lepora, N.F., Mura, A., Prescott, T.J., Verschure, P.F. (eds.) Living Machines 2014. LNCS, vol. 8608, pp. 130–141. Springer, Heidelberg (2014)
Borst, A., Haag, J.: Neural networks in the cockpit of the fly. J. Comp. Physiol. A 188, 419–437 (2002)
Lindemann, J.P., Kern, R., van Hateren, J.H., Ritter, H., Egelhaaf, M.: On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway. J. Neurosci. 25, 6435–6448 (2005)
Krapp, H.G., Hengstenberg, R., Egelhaaf, M.: Binocular Contributions to Optic Flow Processing in the Fly Visual System. J. Neurophysiol. 85, 724–734 (2001)
Hausen, K.: Functional characterization and anatomical identification of motion sensitive neurons in the lobula plate of the blowfly Calliphora erythrocephala. Z Naturforsch, 629–33 (1976)
Egelhaaf, M., Kern, R., Lindemann, J.P.: Motion as a source of environmental information: a fresh view on biological motion computation by insect brains. Front. Neural Circuits. 8, 127 (2014)
Franceschini, N.: Pupil and pseudopupil in the compound eye of drosophila. In: Wehner, R. (ed.) Information Processing in the Visual Systems of Anthropods, pp. 75–82. Springer, Berlin Heidelberg (1972)
Karmeier, K., Tabor, R., Egelhaaf, M., Krapp, H.G.: Early visual experience and the receptive-field organization of optic flow processing interneurons in the fly motion pathway. Vis. Neurosci. 18, 1–8 (2001)
Kern, R., Boeddeker, N., Dittmar, L., Egelhaaf, M.: Blowfly flight characteristics are shaped by environmental features and controlled by optic flow information. J. Exp. Biol. 215, 2501–2514 (2012)
Taylor, G.K., Krapp, H.G.: Sensory systems and flight stability: what do insects measure and why?. In: Casas, J., Simpson, S.J. (eds.) Advances in Insect Physiology, pp. 231–316. Academic Press (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Huang, J.V., Krapp, H.G. (2015). Closed-Loop Control in an Autonomous Bio-hybrid Robot System Based on Binocular Neuronal Input. In: Wilson, S., Verschure, P., Mura, A., Prescott, T. (eds) Biomimetic and Biohybrid Systems. Living Machines 2015. Lecture Notes in Computer Science(), vol 9222. Springer, Cham. https://doi.org/10.1007/978-3-319-22979-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-22979-9_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22978-2
Online ISBN: 978-3-319-22979-9
eBook Packages: Computer ScienceComputer Science (R0)