Abstract
In the search robotics field, human target segmentation method plays a basic preprocessing step in the visual guidance. However, with the wide application of the infrared sensor on robot vision, traditional segmentation methods are facing more challenges of low-contrast, overlapping and blurring targets, and complex background. This paper introduces an infrared human segmentation approach that integrates the improved pulse coupled neural network (PCNN), the curvature gravity gradient tensor (CGGT) and the mathematical morphology to address these above problems. This approach starts with an improved PCNN segmentation model. Local dynamic synapse weights are designed to enhance the synchronous pulsing ability of the improved PCNN model with similar inputs, and a reformed threshold is conducted to guide the process of segmentation. Moreover, eigenvalues of CGGT are guaranteed in this model as linking coefficients, in order to capture the edges and details of human target more exactly in segmentation. Lastly, the segmentation result is repaired by morphology operators, to ensure the integrity of the target region and the independent noise removal. Experiments on 200 real infrared images captured by the mobile robot CQSearcher I, demonstrate that our method is superior over the other classic segmentation methods in both the subjective visual performance and the objective indicators of misclassification error and f-measure.
Similar content being viewed by others
References
Bai X, Chen Z, Zhang Y, Liu Z, Lu Y (2016) Infrared ship target segmentation based on spatial information improved fcm. IEEE Trans Cybern 46(12):3259–3271
Chan TF, Vese LA (2001) Active contours without edges. IEEE Trans Image Process 10(2):266–277
Chen HC, Feng HM, Lin TH, Chen CY, Zha YX (2016) Adapt db-pso patterns clustering algorithms and its applications in image segmentation. Multimed Tools Appl 75(23):15,327–15,339
Chen Y, Ma Y, Kim DH, Park SK (2015) Region-based object recognition by color segmentation using a simplified pcnn. IEEE Trans Neural Netw Learn Syst 26(8):1682–1697
Eckhorn R, Reitboeck HJ, Arndt M, Dicke P (1990) Feature linking via synchronization among distributed assemblies: simulations of results from cat visual cortex. Neural Comput 2(3):293– 307
Gao C, Zhou D, Guo Y (2014) An iterative thresholding segmentation model using a modified pulse coupled neural network. Neural Process Lett 39(1):81–95
Gómez W, Pereira W, Infantosi AFC (2016) Evolutionary pulse-coupled neural network for segmenting breast lesions on ultrasonography. Neurocomputing 175:877–887
Hansen R, Deridder E (2006) Linear feature analysis for aeromagnetic data. Geophysics 71(6):L61– L67
Junyan L, Qingju T, Yang W, Yumei L, Zhiping Z (2014) Defects’ geometric feature recognition based on infrared image edge detection. Infrared Phys Technol 67:387–390
Li Y, Liang S, Bai B, Feng D (2014) Detecting and tracking dim small targets in infrared image sequences under complex backgrounds. Multimed Tools Appl 71(3):1179–1199
Li Y, Li D, Cheng Y, Liu G, Niu J, Su L (2016) A novel human tracking and localization system based on pyroelectric infrared sensors: demonstration abstract. In: Proceedings of the 15th international conference on information processing in sensor networks, p 52. IEEE Press
Li Y, Lu H, Li J, Li X, Li Y, Serikawa S (2016) Underwater image de-scattering and classification by deep neural network. Comput Electr Eng 54:68–77
Lindblad T, Kinser J, Lindblad T, Kinser J (1998) Image processing using pulse-coupled neural networks. Springer
Liu J, Wang H, Wang S (2014) Infrared image segmentation using adaptive fcm algorithm based on potential function. Indones J Electr Eng Comput Sci 12(8):6230–6237
Liu J, Liu Y, Ge Q (2016) Infrared image segmentation based on gray-scale adaptive fuzzy clustering algorithm. Multimedia Tools and Applications, pp 1–15
Liu Y, Nejat G (2013) Robotic urban search and rescue: A survey from the control perspective. J Intell Robot Syst 72(2):147
Liu Z, Zhou F, Chen X, Bai X, Sun C (2014) Iterative infrared ship target segmentation based on multiple features. Pattern Recogn 47(9):2839–2852
Lu H, Zhang L, Zhang M, Hu X, Serikawa S (2010) A method for infrared image segment based on sharp frequency localized contourlet transform and morphology. In: 2010 International conference on intelligent control and information processing (ICICIP), pp 79–82. IEEE
Marzec M, Koprowski R, Wróbel Z, Kleszcz A, Wilczynski S (2015) Automatic method for detection of characteristic areas in thermal face images. Multimed Tools Appl 74(12):4351–4368
Oruç B, Sertçelik I, Kafadar Ö, Selim H (2013) Structural interpretation of the erzurum basin, eastern Turkey, using curvature gravity gradient tensor and gravity inversion of basement relief. J Appl Geophys 88:105–113
Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285-296):23– 27
Park J, Lee G, Park J (2016) Infrared image based human victim recognition for a search and rescue robot. J Inst Robot Syst 22(4):288–292
Powers DMW (2008) Evaluation: from precision, recall and f-factor to roc, informedness, markedness andamp; correlation. J Mach Learn Technol 2:2229–3981
Sakagami N, Choi SK (2016) Robust object tracking for underwater robots by integrating stereo vision, inertial and magnetic sensors. In: Proceedings of the ISCIE international symposium on stochastic systems theory and its applications, vol 2016, pp 259–264. The ISCIE Symposium on Stochastic Systems Theory and Its Applications
Serikawa S, Lu H (2014) Underwater image dehazing using joint trilateral filter. Comput Electr Eng 40(1):41–50
Stahlschmidt C, Gavriilidis A, Velten J, Kummert A (2016) Applications for a people detection and tracking algorithm using a time-of-flight camera. Multimed Tools Appl 75(17):10,769–10786
Tan WC, Isa NAM (2015) Segmentation and detection of human spermatozoa using modified pulse coupled neural network optimized by particle swarm optimization with mutual information. In: 2015 IEEE 10th Conference on industrial electronics and applications (ICIEA), pp 192–197. IEEE
Wang J, Meng X, Li F (2015) Improved curvature gravity gradient tensor with principal component analysis and its application in edge detection of gravity data. J Appl Geophys 118:106– 114
Yang Y, Zha ZJ, Gao Y, Zhu X, Chua TS (2014) Exploiting web images for semantic video indexing via robust sample-specific loss. IEEE Trans Multimed 16 (6):1677–1689
Yang Y, Ma Z, Yang Y, Nie F, Shen HT (2015) Multitask spectral clustering by exploring intertask correlation. IEEE Trans Cybern 45(5):1083–1094
Yasnoff WA, Mui JK, Bacus JW (1977) Error measures for scene segmentation. Pattern Recogn 9(4):217–231
Yin J, Liu L, Li H, Liu Q (2016) The infrared moving object detection and security detection related algorithms based on w4 and frame difference. Infrared Phys Technol 77:302–315
Zhao G, Zhu G, Zeng Y, Zhang T, Xu H (2007) Infrared image segmentation with 2d otsu method based on particle swarm optimization. In: International symposium on multispectral image processing and pattern recognition, pp 678,717–678,717. International Society for Optics and Photonics
Zhou D, Zhou H (2015) A modified strategy of fuzzy clustering algorithm for image segmentation. Soft Comput 19(11):3261–3272
Zhou D, Zhou H, Shao Y (2016) An improved chan–vese model by regional fitting for infrared image segmentation. Infrared Phys Technol 74:81–88
Zhou W, Du X, Li J (2013) The limitation of curvature gravity gradient tensor for edge detection and a method for overcoming it. J Appl Geophys 98:237–242
Zhou Y, Gao M, Fang D, Zhang B (2016) Unsupervised background-constrained tank segmentation of infrared images in complex background based on the otsu method. SpringerPlus 5(1):1409
Acknowledgements
This work was supported by the Ph.D. Programs Foundation of Ministry of Education of China (Grant No.20130191110021), the Fundamental Research Funds for the Central Universities of China(Grant No.XDJK2013C157), and the Program of Study Abroad for Young Scholar Sponsored by China Scholarship Council (Grant No.201506995083).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
He, F., Guo, Y. & Gao, C. Human segmentation of infrared image for mobile robot search. Multimed Tools Appl 77, 10701–10714 (2018). https://doi.org/10.1007/s11042-017-4872-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4872-x