Abstract
At present, underwater exploration and salvage, underwater archaeology, and other underwater operations still mainly rely on professional underwater operators. Considering that artificial underwater operation is faced with the problems of small exploration scope, poor working environment, and low work efficiency, it is the future trend to use robots to replace manual underwater operation in related fields. Most of the current underwater robots are artificial remote-controlled, which lack intelligent detection and autonomous grasping system. In this paper, a grasping robot equipped with an AI computing platform is developed to enable the autonomous grasping of underwater targets by using stereo vision technology. For the problem of difficult detection due to the small size and occlusion of underwater targets, this paper proposes Cascade DetNet, which can improve recognition accuracy. The experimental results show that our proposed method achieves the best performance on URPC dataset compared with several mainstream methods. In addition, we also carry out the autonomous grasping of seafood in a real marine environment to verify the autonomous grasping performance of underwater vehicles.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
ROI is the intersection of Anchor and label divided by the union of Anchor and label.
References
Shi H, Zheng W, Ding D, Yang J (2010) Several views on the study of evaluation of marine ecosystem health in china. In: Proceedings of 2010 International Conference on Challenges in Environmental Science and Computer Engineering, volume 2, pp 124–127. IEEE
Roberts D, Gebruk A, Levin V, Manship BAD (2000) Feeding and digestive strategies in deposit-feeding holothurians. Oceanogr Marine Biol 38:257–310
Schwerzmann M, Seiler C (2001) Recreational scuba diving, patent foramen ovale and their associated risks. Swiss Med Week 131(25–26):365–374
Roos R (1989) Are the risks of sport scuba diving being underestimated? Phys Sportsmed 17(7):132–142
Vann R, Lang M (2011) Recreational diving fatalities. Undersea Hyperb Med 38(4):257–260
Hall J (2014) The risks of scuba diving: a focus on decompression illness. Hawai’i J Med Public Health 73(11 Suppl 2):13
Lacoste É, Boufahja F, Pelaprat C, Le Gall P, Berteaux T, Messiaen Gregory, Mortreux Serge, Oheix Jocelyne, Ouisse Vincent, d’Orbcastel Emmanuelle Roque et al (2020) First simultaneous assessment of macro-and meiobenthic community response to juvenile shellfish culture in a mediterranean coastal lagoon (thau, france). Ecol Indicat 115:106462
Borović B, Vasilijević A, Kuljača O (2011) Potentials of using underwater robotics for fishing and fish farming. In: Proceedings of DEMAT-Development and Evaluation of Maritime Technologies
Cai W, Yan W, Zhang M (2020) Three-dimensional obstacle avoidance for autonomous underwater robot. IEEE Sens Lett 4(11):1–4
Chen W, Wang L, Zhang Y, Li X, Liu J, Wang W (2019) Anti-disturbance grabbing of underwater robot based on retinex image enhancement. In: Proceedings of 2019 Chinese Automation Congress (CAC), pp 2157–2162. IEEE
Hu Z, Zhu X, Tu D, Zhang X, Wang M (2019) Manipulator arm interactive control in unknown underwater environment. In: Proceedings of 2019 2nd World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM), pp 494–498. IEEE
Peralta G, Bonin-Font F, Caiti A (2019) Real-time hash-based loop closure detection in underwater multi-session visual slam. In: Proceedings of OCEANS 2019-Marseille, pp 1–7. IEEE
Zhu A, Song J, Li Y, Wu M, Zhang X (2018) Small cluster underwater robot design with variable pitch propeller. In: Proceedings of 2018 15th International Conference on Ubiquitous Robots (UR), pp 235–240. IEEE
Maki T, Kondo H, Ura T, Nose Y, Sakamaki T (2005) Observation of artificial structures by autonomous underwater vehicle. J Jpn Soc Naval Arch Ocean Eng 1:17–26
Chen W, Wang L, Zhang Y, Li X, Liu J, Wang W (2019) Anti-disturbance grabbing of underwater robot based on retinex image enhancement. In: Proceedings of 2019 Chinese Automation Congress (CAC), pp 2157–2162. IEEE
Jinyu X, Tiedong Z, Hai H, Zexing Z, Qirong T (2017) The development on a streamlined underwater vehicle for autonomous manipulation. In: Proceedings of OCEANS 2017-Aberdeen, pp 1–6. IEEE
Kasparavičiūtė G, Nielsen SA, Boruah D, Nordin P, Dancu A (2018) Plastic grabber: underwater autonomous vehicle simulation for plastic objects retrieval using genetic programming. In: Proceedings of International Conference on Business Information Systems, pp 527–533. Springer
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 779–788
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) Ssd: Single shot multibox detector. In: Proceedings of European Conference on Computer Vision, pp 21–37. Springer
He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916
He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2961–2969
Villon S, Chaumont M, Subsol G, Villéger S, Claverie T, Mouillot D (2016) Coral reef fish detection and recognition in underwater videos by supervised machine learning: Comparison between deep learning and hog+ svm methods. In: Proceedings of International Conference on Advanced Concepts for Intelligent Vision Systems, pp 160–171. Springer
Li X, Shang M, Qin H, Chen L (2015) Fast accurate fish detection and recognition of underwater images with fast r-cnn. In: Proceedings of OCEANS 2015-MTS/IEEE Washington, pp 1–5. IEEE
Li X, Shang M, Hao J, Yang Z (2016) Accelerating fish detection and recognition by sharing cnns with objectness learning. In: Proceedings of OCEANS 2016-Shanghai, pp 1–5. IEEE
Marani G, Choi SK, Yuh J, et al (2007) Experimental study on autonomous manipulation for underwater intervention vehicles. In: Proceedings of the Seventeenth International Offshore and Polar Engineering Conference. International Society of Offshore and Polar Engineers
Ibarra Zannatha JM, Cisneros LR, Gómez SAD, Castillo EH, Medina LEF, Leyva FJKL (2011) Monocular visual self-localization for humanoid soccer robots. In: Proceedings of 21st International Conference on Electrical Communications and Computers, pp 100–107. IEEE
Lee P-M, Jeon B-H, Hong S-W, Lim Y-K, Lee C-M, Park J-W, Lee C-M (2000) System design of an rov with manipulators and adaptive control of it. In: Proceedings of the 2000 International Symposium on Underwater Technology (Cat. No. 00EX418), pp 431–436. IEEE
Zhang M, Zhang L, Li Y (2009) A three-dimensional locating method for underwater robot based on sensors fusion. In: Proceedings of 2009 International Conference on Mechatronics and Automation, pp 1207–1212. IEEE
Martinez-de Dios JR, Serna C, Ollero Aníbal (2003) Computer vision and robotics techniques in fish farms. Robotica 21(3):233
Takagi M, Mori H, Yimit A, Hagihara Y, Miyoshi T (2016) Development of a small size underwater robot for observing fisheries resources-underwater robot for assisting abalone fishing. J Robot Mech 28(3):397–403
Huang H, Tang Q, Li J, Zhang W, Bao X, Zhu Haitao, Wang Gang (2020) A review on underwater autonomous environmental perception and target grasp, the challenge of robotic organism capture. Ocean Eng 195:106644
Strachan NJC (1993) Recognition of fish species by color and shape. Image Vis Comput 11(1):2–10
Spampinato C, Chen-Burger Y-H, Nadarajan G, Fisher RB (2008) Detecting, tracking and counting fish in low quality unconstrained underwater videos. Proc Int Conf Comput Vis Theory Appl 2008(514–519):1
Ren S, He K, Girshick R, Sun J (2016) Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Tran Pattern Anal Mach Intell 39(6):1137–1149
Shao-Kang Z, De-Yan T, Chao W, Xiao-Chuan Z (2018) Intelligent recognition of underwater acoustic target noise on underwater glider platform. In: Proceedings of 2018 Chinese Automation Congress (CAC), pp 4189–4193. IEEE
Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp 1440–1448
Li , Peng C, Yu G, Zhang X, Deng Y, Sun J (2018) Detnet: design backbone for object detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 334–350
Cai Z, Vasconcelos N (2018) Cascade r-cnn: Delving into high quality object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 6154–6162
Zhang S, Wen L, Bian X, Lei Z, Li SZ (2018) Single-shot refinement neural network for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4203–4212
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The research project is partially supported by National Key R\&D Program of China (No. 2021ZD0111902), National Natural Science Foundation of China (No. 62072015, U19B2039, U21B2038).
About this article
Cite this article
Zhang, Y., Zhang, C., Li, B. et al. Underwater autonomous grasping robot based on multi-stage Cascade DetNet. Artif Life Robotics 28, 448–459 (2023). https://doi.org/10.1007/s10015-023-00865-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10015-023-00865-z