Skip to main content
SpringerLink
Log in

Weighting Elementary Movement Detectors Tuned to Different Temporal Frequencies to Estimate Image Velocity

  • Conference paper
  • First Online:
Biomimetic and Biohybrid Systems (Living Machines 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14157))

Included in the following conference series:

  • 585 Accesses

Abstract

Insects’ ability to know the velocity they are flying is of interest to both biologists and roboticists. While the Reichardt detector is one of the most prominent models for insect motion vision, it has various limitations when extracting image velocity in a natural environment. Here we demonstrate a method for estimating image velocity by weighting the outputs of a population of Reichardt detectors where individual detectors are tuned to different temporal frequencies. By providing stimuli of different spatial frequencies and velocities, we then perform a convex optimisation on each average output to find weights. We show that when the weighted detector arrays are provided with different stimuli, the output reasonably approximates image velocity. Our results have implications for power-limited autonomous systems and suggest a potential mechanism for insect motion vision.

Supported by the Defence Science and Technology Laboratory (DSTLX1000161145).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adelson, E.H.: The extraction of spatio-temporal energy in human and machine vision. In: IEEE Workshop on Motion: Representation and Analysis, pp. 151–155 (1986)

    Google Scholar 

  2. Aulinas, J., Petillot, Y., Salvi, J., Lladó, X.: The SLAM problem: a survey. In: Artificial Intelligence Research and Development, pp. 363–371 (2008)

    Google Scholar 

  3. Baker, S., Matthews, I.: Lucas-kanade 20 years on: a unifying framework. Int. J. Comput. Vis. 56, 221–255 (2004). https://doi.org/10.1023/B:VISI.0000011205.11775.fd10.1023/B:VISI.0000011205.11775.fd

    Article  MATH  Google Scholar 

  4. Borst, A., Egelhaaf, M.: Principles of visual motion detection. Trends Neurosci. 12(8), 297–306 (1989)

    Article  Google Scholar 

  5. Borst, A., Egelhaaf, M.: Detecting visual motion: theory and models. In: Visual Motion and Its Role in the Stabilization of Gaze, vol. 3, pp. 3–27 (1993)

    Google Scholar 

  6. Chiappe, M.E., Seelig, J.D., Reiser, M.B., Jayaraman, V.: Walking modulates speed sensitivity in drosophila motion vision. Curr. Biol. 20(16), 1470–1475 (2010)

    Article  Google Scholar 

  7. Cope, A.J., Sabo, C., Gurney, K., Vasilaki, E., Marshall, J.A.: A model for an angular velocity-tuned motion detector accounting for deviations in the corridor-centering response of the bee. PLoS Comput. Biol. 12(5), e1004887 (2016)

    Article  Google Scholar 

  8. D’Angelo, G., et al.: Event-based eccentric motion detection exploiting time difference encoding. Front. Neurosci. 14, 451 (2020)

    Article  Google Scholar 

  9. Eichner, H., Joesch, M., Schnell, B., Reiff, D.F., Borst, A.: Internal structure of the fly elementary motion detector. Neuron 70(6), 1155–1164 (2011)

    Article  Google Scholar 

  10. Esch, H.E., Zhang, S., Srinivasan, M.V., Tautz, J.: Honeybee dances communicate distances measured by optic flow. Nature 411(6837), 581–583 (2001)

    Article  Google Scholar 

  11. Groschner, L.N., Malis, J.G., Zuidinga, B., Borst, A.: A biophysical account of multiplication by a single neuron. Nature 603(7899), 119–123 (2022)

    Article  Google Scholar 

  12. Harris, R.A., O’Carroll, D.C., Laughlin, S.B.: Contrast gain reduction in fly motion adaptation. Neuron 28(2), 595–606 (2000)

    Article  Google Scholar 

  13. Ibbotson, M.: Evidence for velocity-tuned motion-sensitive descending neurons in the honeybee. Proc. Roy. Soc. Lond. Ser. B Biol. Sci. 268(1482), 2195–2201 (2001)

    Article  Google Scholar 

  14. Joesch, M., Weber, F., Eichner, H., Borst, A.: Functional specialization of parallel motion detection circuits in the fly. J. Neurosci. 33(3), 902–905 (2013)

    Article  Google Scholar 

  15. Jung, S.N., Borst, A., Haag, J.: Flight activity alters velocity tuning of fly motion-sensitive neurons. J. Neurosci. 31(25), 9231–9237 (2011)

    Article  Google Scholar 

  16. Kirschfeld, K.: The resolution of lens and compound eyes. In: Zettler, F., Weiler, R. (eds.) Neural Principles in Vision. LIFE SCIENCES, pp. 354–370. Springer, Heidelberg (1976). https://doi.org/10.1007/978-3-642-66432-8_19

    Chapter  Google Scholar 

  17. Land, M.F.: Variations in the structure and design of compound eyes. In: Stavenga, D.G., Hardie, R.C. (eds.) Facets of Vision, pp. 90–111. Springer, Heidelberg (1989). https://doi.org/10.1007/978-3-642-74082-4_5

    Chapter  Google Scholar 

  18. Laughlin, S.B., Hardie, R.C.: Common strategies for light adaptation in the peripheral visual systems of fly and dragonfly. J. Comp. Physiol. 128, 319–340 (1978). https://doi.org/10.1007/BF00657606

    Article  Google Scholar 

  19. Longden, K.D., Krapp, H.G.: State-dependent performance of optic-flow processing interneurons. J. Neurophysiol. 102(6), 3606–3618 (2009)

    Article  Google Scholar 

  20. Longden, K.D., Krapp, H.G.: Sensory neurophysiology: motion vision during motor action. Curr. Biol. 21(17), R650–R652 (2011)

    Article  Google Scholar 

  21. Maddess, T., Laughlin, S.B.: Adaptation of the motion-sensitive neuron H1 is generated locally and governed by contrast frequency. Proc. Roy. Soc. Lond. Ser. B Biol. Sci. 225(1239), 251–275 (1985)

    Google Scholar 

  22. Milde, M.B., Bertrand, O.J., Ramachandran, H., Egelhaaf, M., Chicca, E.: Spiking elementary motion detector in neuromorphic systems. Neural Comput. 30(9), 2384–2417 (2018)

    Article  MathSciNet  Google Scholar 

  23. Nalbach, H.O.: Three temporal frequency channels constitute the dynamics of the optokinetic system of the crab, \(Carcinus\, maenas\) (L.). Biol. Cybern. 61(1), 59–70 (1989)

    Article  Google Scholar 

  24. Niell, C.M., Stryker, M.P.: Modulation of visual responses by behavioral state in mouse visual cortex. Neuron 65(4), 472–479 (2010)

    Article  Google Scholar 

  25. Niven, J.E., Laughlin, S.B.: Energy limitation as a selective pressure on the evolution of sensory systems. J. Exp. Biol. 211(11), 1792–1804 (2008)

    Article  Google Scholar 

  26. Olshausen, B.A., Field, D.J.: Natural image statistics and efficient coding. Netw. Comput. Neural Syst. 7(2), 333–339 (1996)

    Article  Google Scholar 

  27. Pritsker, A.A.B.: Introduction to Simulation and SLAM II. Halsted Press (1984)

    Google Scholar 

  28. Reichardt, W., Egelhaaf, M., Schlögel, R.: Movement detectors provide sufficient information for local computation of 2-D velocity field. Naturwissenschaften 75, 313–315 (1988)

    Article  Google Scholar 

  29. Riabinina, O., Philippides, A.O.: A model of visual detection of angular speed for bees. J. Theor. Biol. 257(1), 61–72 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  30. Rosner, R., Egelhaaf, M., Warzecha, A.K.: Behavioural state affects motion-sensitive neurones in the fly visual system. J. Exp. Biol. 213(2), 331–338 (2010)

    Article  Google Scholar 

  31. Schoepe, T., Gutierrez-Galan, D., Dominguez-Morales, J.P., Jimenez-Fernandez, A., Linares-Barranco, A., Chicca, E.: Neuromorphic sensory integration for combining sound source localization and collision avoidance. In: 2019 IEEE Biomedical Circuits and Systems Conference (BioCAS), pp. 1–4. IEEE (2019)

    Google Scholar 

  32. Schuling, F., Mastebroek, H., Bult, R., Lenting, B.: Properties of elementary movement detectors in the \(flyCalliphora\,erythrocephala\). J. Comp. Physiol. A 165(2), 179–192 (1989). https://doi.org/10.1007/BF00619192

    Article  Google Scholar 

  33. Shoemaker, P.A., O’Carroll, D.C., Straw, A.D.: Velocity constancy and models for wide-field visual motion detection in insects. Biol. Cybern. 93(4), 275–287 (2005). https://doi.org/10.1007/s00422-005-0007-y

    Article  MATH  Google Scholar 

  34. Snippe, H.P., Koenderink, J.J.: Extraction of optical velocity by use of multi-input Reichardt detectors. JOSA A 11(4), 1222–1236 (1994)

    Article  Google Scholar 

  35. Stöckl, A.L., O’Carroll, D.C., Warrant, E.J.: Neural summation in the hawkmoth visual system extends the limits of vision in dim light. Curr. Biol. 26(6), 821–826 (2016)

    Article  Google Scholar 

  36. Van Hateren, J.: Processing of natural time series of intensities by the visual system of the blowfly. Vis. Res. 37(23), 3407–3416 (1997)

    Article  Google Scholar 

  37. Zanker, J.M., Srinivasan, M.V., Egelhaaf, M.: Speed tuning in elementary motion detectors of the correlation type. Biol. Cybern. 80(2), 109–116 (1999). https://doi.org/10.1007/s004220050509

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Imperial College London, Exhibition Rd, South Kensington, London, SW7 2BX, UK

    Benjamin P. Campbell, Huai-Ti Lin & Holger G. Krapp

Authors
  1. Benjamin P. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huai-Ti Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Holger G. Krapp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Benjamin P. Campbell .

Editor information

Editors and Affiliations

  1. Italian Institute of Technology, Genova, Italy

    Fabian Meder

  2. Portland State University, Portland, OR, USA

    Alexander Hunt

  3. Istituto Italiano di Tecnologia, Genova, Italy

    Laura Margheri

  4. Radboud University Nijmegen, Barcelona, Barcelona, Spain

    Anna Mura

  5. Italian Institute of Technology, Genova, Italy

    Barbara Mazzolai

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Campbell, B.P., Lin, HT., Krapp, H.G. (2023). Weighting Elementary Movement Detectors Tuned to Different Temporal Frequencies to Estimate Image Velocity. In: Meder, F., Hunt, A., Margheri, L., Mura, A., Mazzolai, B. (eds) Biomimetic and Biohybrid Systems. Living Machines 2023. Lecture Notes in Computer Science(), vol 14157. Springer, Cham. https://doi.org/10.1007/978-3-031-38857-6_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-38857-6_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-38856-9

  • Online ISBN: 978-3-031-38857-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation