Skip to main content

Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search

  • Conference paper
  • First Online:
Robot 2023: Sixth Iberian Robotics Conference (ROBOT 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 976))

Included in the following conference series:

  • 19 Accesses

Abstract

Cognitive search strategies are highly suitable for Odour Source Localisation (OSL) under turbulent flow conditions where continuous cues are not always available. While reliable, these methods have a known tendency to shift the weight of the search towards exploration, which increases the time and distance required to locate the source. Balancing the trade-off between exploration and exploitation (EE) is crucial since it can directly influence the efficiency and reliability of the mission. However, its understanding from a motion decision perspective still remains unclear with most conclusions being drawn from visual interpretation of the search trajectories or from results of performance metrics. This work aims to study the EE trade-off of cognitive OSL actions by identifying movement patterns and quantifying their values for multiple metrics associated with the decision. A large number of experiments were performed under realistic simulated environments, with the results showing the emergence of multiple well-defined movement patterns and EE tendencies that remain identical across different scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Manjanna, S., Li, A.Q., Smith, R.N., Rekleitis, I., Dudek, G.: Heterogeneous multi-robot system for exploration and strategic water sampling. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 4873–4880 (2018)

    Google Scholar 

  2. Vergassola, M., Villermaux, E., Shraiman, B.I.: ‘infotaxis’ as a strategy for searching without gradients. Nature 445, 406–9 (2007)

    Article  Google Scholar 

  3. Jing, T., Meng, Q.H., Ishida, H.: Recent progress and trend of robot odor source localization. IEEJ Trans. Electr. Electron. Eng. 16, 938–953 2021

    Google Scholar 

  4. Song, C., He, Y., Lei, X.: Autonomous searching for a diffusive source based on minimizing the combination of entropy and potential energy. Sensors 19(11), 2465 (2019)

    Article  Google Scholar 

  5. Rahbar, F., Martinoli, A.: A distributed source term estimation algorithm for multi-robot systems. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 5604–5610 (2020)

    Google Scholar 

  6. Calhoun, A.J., Chalasani, S.H., Sharpee, T.O.: Maximally informative foraging by caenorhabditis elegans. Elife 3, e04220 (2014)

    Article  Google Scholar 

  7. Wolf, H., Wehner, R.: Pinpointing food sources: olfactory and anemotactic orientation in desert ants, cataglyphis fortis. J. Exp. Biol. 203(5), 857–868 (2000)

    Article  Google Scholar 

  8. Thiebault, A., Tremblay, Y.: Splitting animal trajectories into fine-scale behaviorally consistent movement units: breaking points relate to external stimuli in a foraging seabird. Behav. Ecol. Sociobiol. 67, 1013–1026 (2013)

    Article  Google Scholar 

  9. Imirzian, N., Zhang, Y., Kurze, C., Loreto, R.G., Chen, D.Z., Hughes, D.P.: Automated tracking and analysis of ant trajectories shows variation in forager exploration. Sci. Rep. 9(1), 13246 (2019)

    Article  Google Scholar 

  10. Magalhães, H., Baptista, R., Marques, L.: Evaluating cognitive odour source localisation strategies in natural water streams. In: Tardioli, D., Matellán, V., Heredia, G., Silva, M.F., Marques, L. (eds.) Iberian Robotics Conference, vol. 590, pp. 154–165. Springer, Cham. (2023). https://doi.org/10.1007/978-3-031-21062-4_13

  11. Keats, A., Yee, E., Lien, F.-S.: Bayesian inference for source determination with applications to a complex urban environment. Atmos. Environ. 41(3), 465–479 (2007)

    Article  Google Scholar 

  12. Hutchinson, M., Liu, C., Thomas, P., Chen, W.-H.: Unmanned aerial vehicle-based hazardous materials response: information-theoretic hazardous source search and reconstruction. IEEE Robot. Autom. Mag. 27(3), 108–119 (2019)

    Article  Google Scholar 

  13. Cleasby, I.R., et al.: Using time-series similarity measures to compare animal movement trajectories in ecology. Behav. Ecol. Sociobiol. 73, 1–19 (2019)

    Google Scholar 

  14. Balkovsky, E., Shraiman, B.I.: Olfactory search at high Reynolds number. Proc. Nat. Acad. Sci. 99(20), 12589–12593 (2002)

    Google Scholar 

  15. Reddy, G., Murthy, V.N., Vergassola, M.: Olfactory sensing and navigation in turbulent environments. Ann. Rev. Condensed Matter Phys. 13, 191–213 (2022)

    Article  Google Scholar 

  16. Monroy, J., Hernandez-Bennetts, V., Fan, H., Lilienthal, A., Gonzalez-Jimenez, J.: GADEN: a 3D gas dispersion simulator for mobile robot olfaction in realistic environments. Sensors 17(7), 1479 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by PRR Project “Agenda Mobilizadora Sines Nexus” (ref. No. 7113), and by the Portuguese Foundation for Science and Technology (FCT) Ph.D. studentships SFRH/BD/149527/2019 and SFRH/BD/147988/2019, co-founded by the European Social Fund and by the State Budget of the Portuguese Ministry of Education and Science.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lino Marques .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Magalhães, H., Baptista, R., Marques, L. (2024). Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search. In: Marques, L., Santos, C., Lima, J.L., Tardioli, D., Ferre, M. (eds) Robot 2023: Sixth Iberian Robotics Conference. ROBOT 2023. Lecture Notes in Networks and Systems, vol 976. Springer, Cham. https://doi.org/10.1007/978-3-031-58676-7_16

Download citation

Publish with us

Policies and ethics