Xiaohong Peng
ABSTRACT
The rapid development of deep learning has been successfully applied in various fields, including aquaculture, providing new methods and ideas to realize unmanned and intelligent aquaculture. This paper focuses on the technology and research methods used in deep learning for intelligent feeding in fish farming in the past decade, and discusses the application of deep learning in intelligent feeding of fish in detail, including feeding behavior analysis, detection and tracking of live fish, growth state monitoring, residual bait identification and counting, water quality prediction, etc., and summarizes and evaluates the methods, at the same time, analyzes the technical details of the deep learning applied to intelligent precision feeding is analyzed in technical details, including data, algorithms, and evaluation performance indexes. The summarized results show that the advantage of deep learning lies in the automatic extraction of features, which also provides technical support for the construction of intelligent feeding system. However, due to the large differences in fish species, aquaculture environments and data acquisition methods, the technology is less portable, and it is still in the stage of weak artificial intelligence, which requires a large amount of data to train the model, and the cost is high, which has become a bottleneck that restricts the further development of aquaculture. Nevertheless, deep learning has still made breakthroughs in processing complex data. In summary, the purpose of this review is to provide researchers and producers with a better understanding of the current research status of deep learning in intelligent precision feeding of fish, and to provide strong theoretical support for the production process.
- Dong An, Jin Hao, Yaoguang Wei, Yaqian Wang, and Xiaoning Yu. 2021. Application of computer vision in fish intelligent feeding system—A review. Aquaculture Research 52, 2 (February 2021), 423–437. DOI:https://doi.org/10.1111/are.14907Google Scholar
Cross Ref
- Dong An, Jinze Huang, and Yaoguang Wei. 2021. A survey of fish behaviour quantification indexes and methods in aquaculture. Reviews in Aquaculture 13, 4 (September 2021), 2169–2189. DOI:https://doi.org/10.1111/raq.12564Google ScholarCross Ref
- Zhuangzhuang Du, Meng Cui, Qi Wang, Xiaohang Liu, Xianbao Xu, Zhuangzhuang Bai, Chuanyu Sun, Bingxiong Wang, Shuaixing Wang, and Daoliang Li. 2023. Feeding intensity assessment of aquaculture fish using Mel Spectrogram and deep learning algorithms. Aquacultural Engineering 102, (August 2023), 102345. DOI:https://doi.org/10.1016/j.aquaeng.2023.102345Google ScholarCross Ref
- FAO. 2022. The State of World Fisheries and Aquaculture 2022. FAO, Rome. Retrieved from https://doi.org/10.4060/cc0461enGoogle ScholarCross Ref
- Shuangxing Feng, Xinting Yang, Yang Liu, Zhengxi Zhao, Jintao Liu, Yujie Yan, and Chao Zhou. 2022. Fish feeding intensity quantification using machine vision and a lightweight 3D ResNet-GloRe network. Aquacultural Engineering 98, (August 2022), 102244. DOI:https://doi.org/10.1016/j.aquaeng.2022.102244Google ScholarCross Ref
- Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross B. Girshick. 2017. Mask R-CNN. 2017 IEEE International Conference on Computer Vision (ICCV) (2017), 2980–2988.Google Scholar
- Siyue Hou, Jincun Liu, Yaqian Wang, Dong An, and Yaoguang Wei. 2022. Research on fish bait particles counting model based on improved MCNN. Computers and Electronics in Agriculture 196, (May 2022), 106858. DOI:https://doi.org/10.1016/j.compag.2022.106858Google ScholarDigital Library
- Haigang Hu, Chao Tang, Ce Shi, and Yunxia Qian. 2023. Detection of residual feed in aquaculture using YOLO and Mask RCNN. Aquacultural Engineering 100, (February 2023), 102304. DOI:https://doi.org/10.1016/j.aquaeng.2022.102304Google ScholarCross Ref
- Qingchen Kong, Rongxiang Du, Qingling Duan, Yuquan Zhang, Yingyi Chen, Daoliang Li, Chen Xu, Wensheng Li, and Chunhong Liu. 2022. A recurrent network based on active learning for the assessment of fish feeding status. Computers and Electronics in Agriculture 198, (July 2022), 106979. DOI:https://doi.org/10.1016/j.compag.2022.106979Google ScholarDigital Library
- Ivano Lauriola, Alberto Lavelli, and Fabio Aiolli. 2022. An introduction to Deep Learning in Natural Language Processing: Models, techniques, and tools. Neurocomputing 470, (January 2022), 443–456. DOI:https://doi.org/10.1016/j.neucom.2021.05.103Google ScholarDigital Library
- Yann Lecun, Leon Bottou, Y. Bengio, and Patrick Haffner. 1998. Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE 86, (December 1998), 2278–2324. DOI:https://doi.org/10.1109/5.726791Google ScholarCross Ref
- Menghe H. Li, Edwin H. Robinson, and Brian G. Bosworth. 2005. Effects of Periodic Feed Deprivation on Growth, Feed Efficiency, Processing Yield, and Body Composition of Channel Catfish Ictalurus punctatus. Journal of the World Aquaculture Society 36, 4 (December 2005), 444–453. DOI:https://doi.org/10.1111/j.1749-7345.2005.tb00392.xGoogle ScholarCross Ref
- Hanchi Liu, Xin Ma, Yining Yu, Liang Wang, and Hao Lin. 2023. Application of Deep Learning-Based Object Detection Techniques in Fish Aquaculture: A Review. Journal of Marine Science and Engineering 11, 4 (2023), 867. DOI:https://doi.org/10.3390/jmse11040867Google ScholarCross Ref
- Normaisharah Mamat, Mohd Fauzi Othman, Rawad Abdoulghafor, Samir Brahim Belhaouari, Normahira Mamat, and Shamsul Faisal Mohd Hussein. 2022. Advanced Technology in Agriculture Industry by Implementing Image Annotation Technique and Deep Learning Approach: A Review. Agriculture 12, 7 (2022), 1033. DOI:https://doi.org/10.3390/agriculture12071033Google ScholarCross Ref
- Hendrik Purwins, Bo Li, Tuomas Virtanen, Jan Schlüter, Shuo-Yiin Chang, and Tara Sainath. 2019. Deep Learning for Audio Signal Processing. IEEE Journal of Selected Topics in Signal Processing 13, 2 (May 2019), 206–219. DOI:https://doi.org/10.1109/JSTSP.2019.2908700Google ScholarCross Ref
- Rakesh Ranjan, Kata Sharrer, Scott Tsukuda, and Christopher Good. 2023. MortCam: An Artificial Intelligence-aided fish mortality detection and alert system for recirculating aquaculture. Aquacultural Engineering 102, (August 2023), 102341. DOI:https://doi.org/10.1016/j.aquaeng.2023.102341Google ScholarCross Ref
- Qin Ren, Long Zhang, Yaoguang Wei, and Daoliang Li. 2018. A method for predicting dissolved oxygen in aquaculture water in an aquaponics system. Computers and Electronics in Agriculture 151, (August 2018), 384–391. DOI:https://doi.org/10.1016/j.compag.2018.06.013Google ScholarDigital Library
- Naomi Ubina, Shyi-Chyi Cheng, Chin-Chun Chang, and Hung-Yuan Chen. 2021. Evaluating fish feeding intensity in aquaculture with convolutional neural networks. Aquacultural Engineering 94, (August 2021), 102178. DOI:https://doi.org/10.1016/j.aquaeng.2021.102178Google ScholarCross Ref
- He Wang, Song Zhang, Shili Zhao, Qi Wang, Daoliang Li, and Ran Zhao. 2022. Real-time detection and tracking of fish abnormal behavior based on improved YOLOV5 and SiamRPN++. Computers and Electronics in Agriculture 192, (January 2022), 106512. DOI:https://doi.org/10.1016/j.compag.2021.106512Google ScholarDigital Library
- Yaqian Wang, Xiaoning Yu, Jincun Liu, Dong An, and Yaoguang Wei. 2022. Dynamic feeding method for aquaculture fish using multi-task neural network. Aquaculture 551, (March 2022), 737913. DOI:https://doi.org/10.1016/j.aquaculture.2022.737913Google ScholarCross Ref
- Yaqian Wang, Xiaoning Yu, Jincun Liu, Ran Zhao, Liu Zhang, Dong An, and Yaoguang Wei. 2023. Research on quantitative method of fish feeding activity with semi-supervised based on appearance-motion representation. Biosystems Engineering 230, (June 2023), 409–423. DOI:https://doi.org/10.1016/j.biosystemseng.2023.04.011Google ScholarCross Ref
- Yao Wu, Xiaochan Wang, Lin Wang, Xiaolei Zhang, Yinyan Shi, and Ye Jiang. 2023. Dynamic and explainable fish mortality prediction under low-concentration ammonia nitrogen stress. Biosystems Engineering 228, (2023), 178–192. DOI:https://doi.org/10.1016/j.biosystemseng.2023.03.003Google ScholarCross Ref
- Junchao Yang, Lulu Jia, Zhiwei Guo, Yu Shen, Xianwei Li, Zhenping Mou, Keping Yu, and Jerry Chun-Wei Lin. 2023. Prediction and control of water quality in Recirculating Aquaculture System based on hybrid neural network. Engineering Applications of Artificial Intelligence 121, (May 2023), 106002. DOI:https://doi.org/10.1016/j.engappai.2023.106002Google ScholarDigital Library
- Ling Yang, Yingyi Chen, Tao Shen, Huihui Yu, and Daoliang Li. 2023. A BlendMask-VoVNetV2 method for quantifying fish school feeding behavior in industrial aquaculture. Computers and Electronics in Agriculture 211, (August 2023), 108005. DOI:https://doi.org/10.1016/j.compag.2023.108005Google ScholarDigital Library
- Chuang Yu, Zhuhua Hu, Bing Han, Yutong Dai, Yaochi Zhao, and Yingjun Deng. 2023. An intelligent measurement scheme for basic characters of fish in smart aquaculture. Computers and Electronics in Agriculture 204, (January 2023), 107506. DOI:https://doi.org/10.1016/j.compag.2022.107506Google ScholarDigital Library
- Xiaoning Yu, Yaqian Wang, Jincun Liu, Jia Wang, Dong An, and Yaoguang Wei. 2022. Non-contact weight estimation system for fish based on instance segmentation. Expert Systems with Applications 210, (December 2022), 118403. DOI:https://doi.org/10.1016/j.eswa.2022.118403Google ScholarDigital Library
- Yuhao Zeng, Xinting Yang, Liang Pan, Wentao Zhu, Dinghong Wang, Zhengxi Zhao, Jintao Liu, Chuanheng Sun, and Chao Zhou. 2023. Fish school feeding behavior quantification using acoustic signal and improved Swin Transformer. Computers and Electronics in Agriculture 204, (January 2023), 107580. DOI:https://doi.org/10.1016/j.compag.2022.107580Google ScholarDigital Library
- Lu Zhang, Jianping Wang, and Qingling Duan. 2020. Estimation for fish mass using image analysis and neural network. Computers and Electronics in Agriculture 173, (June 2020), 105439. DOI:https://doi.org/10.1016/j.compag.2020.105439Google ScholarCross Ref
- Yuquan Zhang, Chen Xu, Rongxiang Du, Qingchen Kong, Daoliang Li, and Chunhong Liu. 2023. MSIF-MobileNetV3: An improved MobileNetV3 based on multi-scale information fusion for fish feeding behavior analysis. Aquacultural Engineering 102, (August 2023), 102338. DOI:https://doi.org/10.1016/j.aquaeng.2023.102338Google ScholarCross Ref
- Shili Zhao, Song Zhang, Jincun Liu, He Wang, Jia Zhu, Daoliang Li, and Ran Zhao. 2021. Application of machine learning in intelligent fish aquaculture: A review. Aquaculture 540, (July 2021), 736724. DOI:https://doi.org/10.1016/j.aquaculture.2021.736724Google ScholarCross Ref
- Shili Zhao, Song Zhang, Jiamin Lu, He Wang, Yu Feng, Chen Shi, Daoliang Li, and Ran Zhao. 2022. A lightweight dead fish detection method based on deformable convolution and YOLOV4. Computers and Electronics in Agriculture 198, (July 2022), 107098. DOI:https://doi.org/10.1016/j.compag.2022.107098Google ScholarDigital Library
- Chao Zhou, Daming Xu, Lan Chen, Song Zhang, Chuanheng Sun, Xinting Yang, and Yanbo Wang. 2019. Evaluation of fish feeding intensity in aquaculture using a convolutional neural network and machine vision. Aquaculture 507, (May 2019), 457–465. DOI:https://doi.org/10.1016/j.aquaculture.2019.04.056Google ScholarCross Ref
- Yueming Zhou, Junchao Yang, Amr Tolba, Fayez Alqahtani, Xin Qi, and Yu Shen. 2023. A Data-Driven Intelligent Management Scheme for Digital Industrial Aquaculture based on Multi-object Deep Neural Network. Mathematical Biosciences and Engineering 20, 6 (2023), 10428–10443. DOI:https://doi.org/10.3934/mbe.2023458Google ScholarCross Ref
Index Terms
- A Survey of Deep Learning for Intelligent Feeding in Smart Fish Farming
Recommendations
Comparison of Deep Learning based Fish Detection Performance for Real-Time Smart Fish Farming
SMA 2020: The 9th International Conference on Smart Media and ApplicationsWorld aquaculture production continues to grow. However, the process of aquaculture is still dependent on human experience. With the recent development of artificial intelligence technology, automation has been achieved in various industrial fields. In ...
Applications of deep learning in fish habitat monitoring: A tutorial and survey
AbstractMarine ecosystems and their fish habitats are becoming increasingly important due to their integral role in providing a valuable food source and conservation outcomes. Due to their remote and difficult to access nature, marine environments and ...
Highlights- Marine environments and fish habitats are widely surveyed using underwater cameras.
- Deep learning (DL) offers an effective solution for processing underwater videos.
- We write a tutorial on the key concepts and steps of DL for ...
A smart fish feeding system for internet of things based aquariums
ICONIC '20: Proceedings of the 2nd International Conference on Intelligent and Innovative Computing ApplicationsEffective fish feeding within aquarium environments is essential for proper health and growth of fishes. However, due to busy lifestyles, maintaining proper feeding cycles is a key challenge for aquarium owners. With the emergence of technologies ...
Comments