Abstract
Honey bees are critical in pollination worldwide and are essential for crop productivity and ecological management. Knowing more about honeybees and their interaction with plants is urgently needed given the current global pollination crisis. For monitoring pollination, non-invasive approaches are recommended because they diminish the possibility of interfering with pollinator behaviour. Traditional techniques for manually recording pollinator activity in the field can be expensive and time-consuming. In this paper, we have developed a system for pollination monitoring by honeybees using computer vision technique. However, monitoring honeybees is challenging because of their tiny size, swift speed and complex outdoor environments. To detect honeybees in a frame, we have used YOLOv7 as our deep learning model. We have fine-tuned the model on a custom-created dataset for better detection and accuracy. The dataset contains snapshots of YouTube videos in which honeybees were pollinating flowers in different environments. We examined a specific setting where the honeybee pollinated the flowers at several intervals during the video using the detector. We have generated a heatmap and pollination activity graph based on the data from the detector. This information will help with better pollination management, which will increase crop production quality and yield.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
FAO. Why bees matter; the importance of bees and other pollinators for food and agriculture (2018)
Aizen, M.A., Garibaldi, L.A., Cunningham, S.A., Klein, A.M.: How much does agriculture depend on pollinators? lessons from long-term trends in crop production. Ann. Botany 103(9), 1579–1588 (2009). https://doi.org/10.1093/aob/mcp076
Potts, S., Imperatriz-Fonseca, V., Ngo, H., et al.: Safeguarding pollinators and their values to human well-being. Nature 540, 220–229 (2016). https://doi.org/10.1038/nature20588
Rollin, O., Garibaldi, L.A.: Impacts of honeybee density on crop yield: a meta-analysis. J. Appl. Ecol. 56(5), 1152–63 (2019). https://doi.org/10.1111/1365-2664.13355
Garibaldi, L.A., Sáez, A., Aizen, M.A., Fijen, T., Bartomeus, I.: Crop pollination management needs flower-visitor monitoring and target values. J. Appl. Ecol. 57(4), 664–70 (2020). https://doi.org/10.1111/1365-2664.13574
Garibaldi, L.A., Requier, F., Rollin, O., Andersson, G.K.: Towards an integrated species and habitat management of crop pollination. Curr. Opin. Insect Sci. 1(21), 105–14 (2017). https://doi.org/10.1016/j.cois.2017.05.016
Abdel-Raziq, H.M., Palmer, D.M., Koenig, P.A., et al.: System design for inferring colony-level pollination activity through miniature bee-mounted sensors. Sci. Rep. 11, 4239 (2021). https://doi.org/10.1038/s41598-021-82537-1
Ratnayake, M.N., Dyer, A.G., Dorin, A.: Towards computer vision and deep learning facilitated pollination monitoring for agriculture. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2921–2930 (2021)
Bjerge, K., Mann, H.M., Høye, T.T.: Real-time insect tracking and monitoring with computer vision and deep learning. Remote Sens. Ecol. Cons. (2021). https://doi.org/10.1002/rse2.245
Bjerge, K., Nielsen, J.B., Sepstrup, M.V., Helsing-Nielsen, F., Høye, T.T.: An automated light trap to monitor moths (lepidoptera) using computer vision-based tracking and deep learning. Sensors 21, 343 (2021). https://doi.org/10.3390/s21020343
Ratnayake, M.N., Dyer, A.G., Dorin, A.: Tracking individual honeybees among wildflower clusters with computer vision-facilitated pollinator monitoring. PLoS ONE 16(2), e0239504 (2021). https://doi.org/10.1371/journal.pone.0239504
Bochkovskiy, A., Wang, C.Y., Liao, H.Y.: Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934. Accessed 23 Apr 2020
Zivkovic, Z., Van Der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recogn. Lett. 27(7), 773–80 (2006). https://doi.org/10.1016/j.patrec.2005.11.005
Ratnayake, M.N., Amarathunga, D.C., Zaman, A., Dyer, A.G., Dorin, A.: Spatial Monitoring and Insect Behavioural Analysis Using Computer Vision for Precision Pollination. arXiv preprint arXiv:2205.04675. Accessed 10 May 2022
Wang, C.Y., Bochkovskiy, A., Liao, H.Y.: YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696. Accessed 6 July 2022
Jolles, J.W.: Broad-scale applications of the raspberry pi: a review and guide for biologists. Methods Ecol. Evol. 12(9), 1562–79 (2021). https://doi.org/10.1111/2041-210X.13652
Plant Mama Tatiana: First Signs of Spring. https://www.youtube.com/watch?v=lSr9smZJK-E, Accessed 19 July 2022
Painkra, G.P.: Giant bee foraging on chhuimui flower. https://www.youtube.com/watch?v=-iFtx1cmoEw, Accessed 19 July 2022
98 Honey Bees: Honey Bees Foraging on Dandelions. https://www.youtube.com/watch?v=oroi3bvj_JE, Accessed 19 July 2022
Bisi Bisi Coffee: Busy bees pollinating lemon flowers. https://www.youtube.com/watch?v=ty6zB75Lk7c, Accessed 19 July 2022
Media Space: Honeybees pollinating coconut flower. https://www.youtube.com/watch?v=kcduLTz2Zoo, Accessed 19 July 2022
Prithvi Media Creations: Pollination Process Sunflower and Bee. https://www.youtube.com/watch?v=klEQG76OG0w, Accessed 19 July 2022
Ystwyth Valley Apple Breeders: Bees pollinating apple blossom: Beauty of Bath. https://www.youtube.com/watch?v=le0PAWrilZI, Accessed 19 July 2022
Ystwyth Valley Apple Breeders: Bees pollinating apple blossom: Lord Lambourne. https://www.youtube.com/watch?v=RMSFHlHf1tc, Accessed 19 July 2022
Acknowledgements
This work is supported by the grant received from DST, Govt. of India for the Technology Innovation Hub at the IIT Ropar in the framework of the National Mission on Interdisciplinary Cyber-Physical Systems.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kujur, V., Bedi, A.K., Saini, M. (2023). Monitoring Pollination by Honeybee Using Computer Vision. In: Zaynidinov, H., Singh, M., Tiwary, U.S., Singh, D. (eds) Intelligent Human Computer Interaction. IHCI 2022. Lecture Notes in Computer Science, vol 13741. Springer, Cham. https://doi.org/10.1007/978-3-031-27199-1_40
Download citation
DOI: https://doi.org/10.1007/978-3-031-27199-1_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-27198-4
Online ISBN: 978-3-031-27199-1
eBook Packages: Computer ScienceComputer Science (R0)