Abstract
Knowledge on body-length and mass of farmed fishes are essential for making informed business decisions in aqua-farming. These reduce wastage and promote sustainability that is critical for ecological preservation. In this paper, we present an approach for automatically determining the length and mass of fishes from images taken by a single camera placed above the fish-tank. Our motivation is to develop a solution that requires minimal hardware requirement and expert supervision for wide applicability. This is in sharp contrast with existing work in this area that employ complex hardware setup, e.g., stereo cameras, underwater camera, submerged tubes with twin-camera setup. These require technical expertise which ideally is not available to small businesses. Furthermore, our approach works with live fish in water compared to other techniques that work on dead fish. We evaluate different variants of the Mask-RCNN and YOLO algorithms for automatic fish detection. Subsequently, we use B-splines for estimating the length of fish in the pixel domain followed by physical length determination using optics. We obtain a mean average precision of 0.896 for the bounding box and a mean average precision of 0.902 for mask-based detection of fish with the YOLO model. The average error in physical length estimation is 3.32%. Lastly, we estimate the mass of fish by fitting the Length-Weight relationship using regression and obtain an average error of 12.24% in weight determination.
This research was funded in part by the German Federal Ministry of Education and Research (BMBF) under the project FishAI (Grant number 031B1252B).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Blum, H.: Models for the perception of speech and visual form. In: Wathen-Dunn, W. (ed.) Proceedings of the Models for the Perception of Speech and Visual Form. pp. 362–380. MIT Press, Cambridge, MA (1967)
Bradley, D., Merrifield, M., Miller, K.M., Lomonico, S., Wilson, J.R., Gleason, M.G.: Opportunities to improve fisheries management through innovative technology and advanced data systems. Fish Fish. 20(3), 564–583 (2019)
Martinez-de Dios, J., Serna, C., Ollero, A.: Computer vision and robotics techniques in fish farms. Robotica 21(3), 233–243 (2003)
FAO: The state of world fisheries and aquaculture 2018 - meeting the sustainable development goals. FAO 978-92-5-130562-1 (2018)
Garcia, R., et al.: Automatic segmentation of fish using deep learning with application to fish size measurement. ICES J. Marine Sci. 77(4), 1354–1366 (2019). https://doi.org/10.1093/icesjms/fsz186
Garcia-d’Urso, N., et al.: The deepFish computer vision dataset for fish instance segmentation, classification, and size estimation. Sci. Data 9(1), 287 (2022)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 142–158 (2015)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
Jocher, G.: ultralytics/yolov5: v6.2 - YOLOv5 Classification Models, Apple M1, Reproducibility, ClearML and Deci.ai integrations (2022). https://doi.org/10.5281/zenodo.7002879
Koch, E., Rosolowsky, E.: Filament identification through mathematical morphology. Mon. Not. R. Astron. Soc. 452(4), 3435–3450 (2015)
Konovalov, D.A., Saleh, A., Efremova, D.B., Domingos, J.A., Jerry, D.R.: Automatic weight estimation of harvested fish from images. In: 2019 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–7. IEEE (2019)
Le Cren, E.D.: The length-weight relationship and seasonal cycle in gonad weight and condition in the perch (Perca fluviatilis). J. Animal Ecol. 201–219 (1951)
Monkman, G., Hyder, K., Kaiserc, M., Vidal, F.: Using machine vision to estimate fish length from images using regional convolutional neural networks. Meth. Ecol. Evol. 10, 2045–2056 (2019). https://doi.org/10.1111/2041-210x.13282
Monkman, G.G., Hyder, K., Kaiser, M.J., Vidal, F.P.: Accurate estimation of fish length in single camera photogrammetry with a fiducial marker. ICES J. Marine Sci. 77(6), 2245–2254 (2019). https://doi.org/10.1093/icesjms/fsz030
O’Neill, E.A., Stejskal, V., Clifford, E., Rowan, N.J.: Novel use of peatlands as future locations for the sustainable intensification of freshwater aquaculture production – a case study from the republic of Ireland. Sci. Total Environ. 706, 136044 (2020). https://doi.org/10.1016/j.scitotenv.2019.136044
Palmer, M., Álvarez Ellacuría, A., Moltó, V., Catalán, I.A.: Automatic, operational, high-resolution monitoring of fish length and catch numbers from landings using deep learning. Fish. Res. 246, 106166 (2022). https://doi.org/10.1016/j.fishres.2021.106166
Petrell, R., Shi, X., Ward, R., Naiberg, A., Savage, C.: Determining fish size and swimming speed in cages and tanks using simple video techniques. Aquacult. Eng. 16(1–2), 63–84 (1997)
Rauf, H.T., Lali, M.I.U., Zahoor, S., Shah, S.Z.H., Rehman, A.U., Bukhari, S.A.C.: Visual features based automated identification of fish species using deep convolutional neural networks. Comput. Electron. Agric. 167, 105075 (2019)
Rosen, S., Jörgensen, T., Hammersland-White, D., Holst, J.C.: DeepVision: a stereo camera system provides highly accurate counts and lengths of fish passing inside a trawl. Can. J. Fish. Aquat. Sci. 70(10), 1456–1467 (2013). https://doi.org/10.1139/cjfas-2013-0124, https://doi.org/10.1139/cjfas-2013-0124
Saleh, A., Laradji, I.H., Konovalov, D.A., Bradley, M., Vazquez, D., Sheaves, M.: A realistic fish-habitat dataset to evaluate algorithms for underwater visual analysis. Sci. Rep. 10(1), 14671 (2020). https://doi.org/10.1038/s41598-020-71639-x
Siddiqui, S.A., et al.: Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data. ICES J. Mar. Sci. 75(1), 374–389 (2018)
Tillett, R., McFarlane, N., Lines, J.: Estimating dimensions of free-swimming fish using 3D point distribution models. Comput. Vis. Image Underst. 79(1), 123–141 (2000)
Tseng, C.H., Hsieh, C.L., Kuo, Y.F.: Automatic measurement of the body length of harvested fish using convolutional neural networks. Biosys. Eng. 189, 36–47 (2020)
Vo, T.T.E., Ko, H., Huh, J.H., Kim, Y.: Overview of smart aquaculture system: focusing on applications of machine learning and computer vision. Electronics 10(22), 2882 (2021)
Yang, L., et al.: Computer vision models in intelligent aquaculture with emphasis on fish detection and behavior analysis: a review. Arch. Comput. Meth. Eng. 28, 2785–2816 (2021)
Zhou, C., et al.: An adaptive image enhancement method for a recirculating aquaculture system. Sci. Rep. 7(1), 6243 (2017)
Zhou, C., et al.: Near-infrared imaging to quantify the feeding behavior of fish in aquaculture. Comput. Electron. Agric. 135, 233–241 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Biswas, R., Khonsari, R., Mutz, M., Werth, D. (2024). A Study on Automatic Detection, Length and Mass Estimation of Fishes in Aqua Farming Environment. In: Santosh, K., et al. Recent Trends in Image Processing and Pattern Recognition. RTIP2R 2023. Communications in Computer and Information Science, vol 2026. Springer, Cham. https://doi.org/10.1007/978-3-031-53082-1_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-53082-1_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53081-4
Online ISBN: 978-3-031-53082-1
eBook Packages: Computer ScienceComputer Science (R0)