Skip to main content

Monitoring Pollination by Honeybee Using Computer Vision

  • Conference paper
  • First Online:
Intelligent Human Computer Interaction (IHCI 2022)

Abstract

Honey bees are critical in pollination worldwide and are essential for crop productivity and ecological management. Knowing more about honeybees and their interaction with plants is urgently needed given the current global pollination crisis. For monitoring pollination, non-invasive approaches are recommended because they diminish the possibility of interfering with pollinator behaviour. Traditional techniques for manually recording pollinator activity in the field can be expensive and time-consuming. In this paper, we have developed a system for pollination monitoring by honeybees using computer vision technique. However, monitoring honeybees is challenging because of their tiny size, swift speed and complex outdoor environments. To detect honeybees in a frame, we have used YOLOv7 as our deep learning model. We have fine-tuned the model on a custom-created dataset for better detection and accuracy. The dataset contains snapshots of YouTube videos in which honeybees were pollinating flowers in different environments. We examined a specific setting where the honeybee pollinated the flowers at several intervals during the video using the detector. We have generated a heatmap and pollination activity graph based on the data from the detector. This information will help with better pollination management, which will increase crop production quality and yield.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. FAO. Why bees matter; the importance of bees and other pollinators for food and agriculture (2018)

    Google Scholar 

  2. Aizen, M.A., Garibaldi, L.A., Cunningham, S.A., Klein, A.M.: How much does agriculture depend on pollinators? lessons from long-term trends in crop production. Ann. Botany 103(9), 1579–1588 (2009). https://doi.org/10.1093/aob/mcp076

    Article  Google Scholar 

  3. Potts, S., Imperatriz-Fonseca, V., Ngo, H., et al.: Safeguarding pollinators and their values to human well-being. Nature 540, 220–229 (2016). https://doi.org/10.1038/nature20588

    Article  Google Scholar 

  4. Rollin, O., Garibaldi, L.A.: Impacts of honeybee density on crop yield: a meta-analysis. J. Appl. Ecol. 56(5), 1152–63 (2019). https://doi.org/10.1111/1365-2664.13355

    Article  Google Scholar 

  5. Garibaldi, L.A., Sáez, A., Aizen, M.A., Fijen, T., Bartomeus, I.: Crop pollination management needs flower-visitor monitoring and target values. J. Appl. Ecol. 57(4), 664–70 (2020). https://doi.org/10.1111/1365-2664.13574

    Article  Google Scholar 

  6. Garibaldi, L.A., Requier, F., Rollin, O., Andersson, G.K.: Towards an integrated species and habitat management of crop pollination. Curr. Opin. Insect Sci. 1(21), 105–14 (2017). https://doi.org/10.1016/j.cois.2017.05.016

    Article  Google Scholar 

  7. Abdel-Raziq, H.M., Palmer, D.M., Koenig, P.A., et al.: System design for inferring colony-level pollination activity through miniature bee-mounted sensors. Sci. Rep. 11, 4239 (2021). https://doi.org/10.1038/s41598-021-82537-1

    Article  Google Scholar 

  8. Ratnayake, M.N., Dyer, A.G., Dorin, A.: Towards computer vision and deep learning facilitated pollination monitoring for agriculture. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2921–2930 (2021)

    Google Scholar 

  9. Bjerge, K., Mann, H.M., Høye, T.T.: Real-time insect tracking and monitoring with computer vision and deep learning. Remote Sens. Ecol. Cons. (2021). https://doi.org/10.1002/rse2.245

    Article  Google Scholar 

  10. Bjerge, K., Nielsen, J.B., Sepstrup, M.V., Helsing-Nielsen, F., Høye, T.T.: An automated light trap to monitor moths (lepidoptera) using computer vision-based tracking and deep learning. Sensors 21, 343 (2021). https://doi.org/10.3390/s21020343

    Article  Google Scholar 

  11. Ratnayake, M.N., Dyer, A.G., Dorin, A.: Tracking individual honeybees among wildflower clusters with computer vision-facilitated pollinator monitoring. PLoS ONE 16(2), e0239504 (2021). https://doi.org/10.1371/journal.pone.0239504

    Article  Google Scholar 

  12. Bochkovskiy, A., Wang, C.Y., Liao, H.Y.: Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934. Accessed 23 Apr 2020

  13. Zivkovic, Z., Van Der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recogn. Lett. 27(7), 773–80 (2006). https://doi.org/10.1016/j.patrec.2005.11.005

    Article  Google Scholar 

  14. Ratnayake, M.N., Amarathunga, D.C., Zaman, A., Dyer, A.G., Dorin, A.: Spatial Monitoring and Insect Behavioural Analysis Using Computer Vision for Precision Pollination. arXiv preprint arXiv:2205.04675. Accessed 10 May 2022

  15. Wang, C.Y., Bochkovskiy, A., Liao, H.Y.: YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696. Accessed 6 July 2022

  16. Jolles, J.W.: Broad-scale applications of the raspberry pi: a review and guide for biologists. Methods Ecol. Evol. 12(9), 1562–79 (2021). https://doi.org/10.1111/2041-210X.13652

    Article  Google Scholar 

  17. Plant Mama Tatiana: First Signs of Spring. https://www.youtube.com/watch?v=lSr9smZJK-E, Accessed 19 July 2022

  18. Painkra, G.P.: Giant bee foraging on chhuimui flower. https://www.youtube.com/watch?v=-iFtx1cmoEw, Accessed 19 July 2022

  19. 98 Honey Bees: Honey Bees Foraging on Dandelions. https://www.youtube.com/watch?v=oroi3bvj_JE, Accessed 19 July 2022

  20. Bisi Bisi Coffee: Busy bees pollinating lemon flowers. https://www.youtube.com/watch?v=ty6zB75Lk7c, Accessed 19 July 2022

  21. Media Space: Honeybees pollinating coconut flower. https://www.youtube.com/watch?v=kcduLTz2Zoo, Accessed 19 July 2022

  22. Prithvi Media Creations: Pollination Process Sunflower and Bee. https://www.youtube.com/watch?v=klEQG76OG0w, Accessed 19 July 2022

  23. Ystwyth Valley Apple Breeders: Bees pollinating apple blossom: Beauty of Bath. https://www.youtube.com/watch?v=le0PAWrilZI, Accessed 19 July 2022

  24. Ystwyth Valley Apple Breeders: Bees pollinating apple blossom: Lord Lambourne. https://www.youtube.com/watch?v=RMSFHlHf1tc, Accessed 19 July 2022

Download references

Acknowledgements

This work is supported by the grant received from DST, Govt. of India for the Technology Innovation Hub at the IIT Ropar in the framework of the National Mission on Interdisciplinary Cyber-Physical Systems.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vinit Kujur .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kujur, V., Bedi, A.K., Saini, M. (2023). Monitoring Pollination by Honeybee Using Computer Vision. In: Zaynidinov, H., Singh, M., Tiwary, U.S., Singh, D. (eds) Intelligent Human Computer Interaction. IHCI 2022. Lecture Notes in Computer Science, vol 13741. Springer, Cham. https://doi.org/10.1007/978-3-031-27199-1_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27199-1_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27198-4

  • Online ISBN: 978-3-031-27199-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics