Skip to main content
SpringerLink
Log in

Temperature-based alternate perception method for human-motion detection with visually impaired user applications

  • Regular Paper
  • Published:
International Journal of Intelligent Robotics and Applications Aims and scope Submit manuscript

Abstract

This paper presents an alternate perception method to improve the perception ability of the blind/visually impaired people who are generally familiar with stationary objects but less confident in congested environment where human motion is unpredictable. This method, taking advantages of the fact that the human body is essentially a natural heat source, utilizes temperature fields and their gradients from infrared (IR) images to locate individual humans in a relatively congested area and determine their face orientation and motion states. Unlike conventional illumination-sensitive visual images that often include many unrelated details, the normalized IR images in this method are naturally pre-filtered, effectively removing unwanted background “noise”, which greatly simplifies the subsequent image processing tasks. The temperature-based method has been illustrated with three realistic scenes commonly encountered in daily walking. Practical implementation issues, which include the effects of low image resolution, overlapping/occlusions, reflection and non-human heat sources on the face orientation detection, are discussed; and their effects on the effectiveness and robustness of the method are experimentally investigated. The experimental findings offer physically intuitive insights into the development of alternate perception methods based on temperature field and its potential applications in intelligent space, smart city and smart cars.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  • Ando, B.: A smart multisensor approach to assist blind people in specific urban navigation tasks. IEEE Trans. Neural Syst. Rehab. Eng. 16(6), 592–594 (2008)

    Article  Google Scholar 

  • Ando, B., Baglio, S., Marletta, V., Valastro, A.: A haptic solution to assist visually impaired in mobility tasks. IEEE Trans. Human Mach. Syst. 45(5), 635–640 (2015)

    Article  Google Scholar 

  • Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2002)

    Article  Google Scholar 

  • Bourbakis, N., Makrogiannis, S.K., Dakopoulos, D.: A system-prototype representing 3D space via alternative-sensing for visually impaired navigation. IEEE Sens. J. 13(7), 2535–2547 (2013)

    Article  Google Scholar 

  • Correa, D.S.O., Sciotti, D.F., Prado, M.G., et al.: Mobile robots navigation in indoor environments using kinect sensor. Crit. Embedded Syst. IEEE, 36–41 (2012)

  • Dakopoulos, D., Bourbakis, N.N.G.: Wearable obstacle avoidance electronic travel aids for blind: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 40(1), 25–235 (2010)

    Article  Google Scholar 

  • Fujiyoshi, H., Lipton, A.J.: Real-time human motion analysis by image skeletonization. In: Proceedings of Fourth IEEE Workshop on IEEE Applications of Computer Vision, 1998, WACV ‘98. 87(1), 15–21 (2002)

  • Gade, R., Moeslund, T.B.: Thermal cameras and applications: a survey. Mach. Vis. Appl. 25(1), 245–262 (2014)

    Article  Google Scholar 

  • Garaj, V., Hunaiti, Z., Balachandran, W.: Using remote vision: the effects of video image frame rate on visual object recognition performance. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans 40(4), 698–707 (2010)

    Article  Google Scholar 

  • Hecht, J.: Under the hood of Luminar’s long-reach lidar. In: IEEE Spectrum. Online posted 5 July 2017

  • Heo, J., Kong, S.G., Abidi, B.R., et al.: Fusion of visual and thermal signatures with eyeglass removal for robust face recognition. Conf. Comput. Vis. Pattern Recognit. Workshop IEEE 8, 122 (2004)

    Google Scholar 

  • Hunaiti, Z., Garaj, V., Balachandran, W.: An assessment of a mobile communication link for a system to navigate visually impaired people. IEEE Trans. Instrum. Meas. 58(9), 3263–3268 (2009)

    Article  Google Scholar 

  • Jiang, J.Y., Lee, K.-M., Ji, J.J.: Physical field-enhanced intelligent space with temperature-based human motion detection for visually impaired users. In: ICIRA2017, Wuhan, China (2017)

  • Jones, B.F.: A reappraisal of the use of infrared thermal image analysis in medicine. IEEE Trans. Med. Imaging 17(6), 1019–1027 (1999)

    Article  Google Scholar 

  • Kundu, B.: Exact analysis for propagation of heat in a biological tissue subject to different surface conditions for therapeutic applications. Appl. Math. Comput. 285, 204–216 (2016)

    MathSciNet  Google Scholar 

  • Lee, K.-M., Li, M.: Magnetic tensor sensor for gradient-based localization of ferrous object in geomagnetic field. IEEE Trans. Magn. 52(8), 1–10 (2016)

    Article  Google Scholar 

  • Lee, K.-M., Li, M., Lin, C.-Y.: Magnetic tensor sensor and way-finding method based on geomagnetic field effects with applications for visually impaired users. IEEE/ASME Trans. Mechatron. 21(6), 2694–2704 (2016)

    Article  Google Scholar 

  • Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Comput. Vis. Image Underst. 81(3), 231–268 (2001)

    Article  MATH  Google Scholar 

  • Pennes, H.H.: Analysis of tissue and arterial blood temperatures in the resting human forearm. J. Appl. Physiol. 85(1), 5–34 (1998)

    Article  Google Scholar 

  • Rudol, P., Doherty, P.: Human body detection and geolocalization for UAV search and rescue missions using color and thermal imagery. In: Aerospace Conference IEEE, 1–8 (2008)

  • Treptow, A., Cielniak, G., Duckett, T.: Real-time people tracking for mobile robots using thermal vision. Robot. Auton. Syst. 54(9), 729–739 (2006)

    Article  Google Scholar 

  • Xiao, J., Joseph, S.L., Zhang, X., Li, B., Li, X., Zhang, J.: An assistive framework for the visually impaired. IEEE Trans. Human Mach. Syst. 45(5), 635–640 (2015)

    Article  Google Scholar 

  • Yin, X.: Motion detection and tracking using the 3D-camera. IFAC Proc. Volumes 44(1), 14139–14144 (2011)

    Article  Google Scholar 

  • Yovanof, G.S., Hazapis, G.N.: An architectural framework and enabling wireless technologies for digital cities & intelligent urban environments. Wireless Pers. Commun. 49(3), 445–463 (2009)

    Article  Google Scholar 

  • Zhang, D.: Surface temperature distribution and infrared image analysis of normal human body. Laser Infrared 17(3), 52–56 (1994)

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the U. S. National Science Foundation EFRI-M3C 1137172, National Natural Science Foundation of China (51505168) and National Basic Research Program of China (973 Program, Grant No. 2013CB035803). The support of the Wuhan blind school and the valuable discussions with Mr. Shiyong Zou (particularly the sharing of his personal experience) are greatly appreciated.

Author information

Authors and Affiliations

  1. State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China

    Jiaoying Jiang, Kok-Meng Lee & Jingjing Ji

  2. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332-0405, USA

    Kok-Meng Lee

Authors
  1. Jiaoying Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kok-Meng Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jingjing Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kok-Meng Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, J., Lee, KM. & Ji, J. Temperature-based alternate perception method for human-motion detection with visually impaired user applications. Int J Intell Robot Appl 1, 383–398 (2017). https://doi.org/10.1007/s41315-017-0035-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41315-017-0035-5

Keywords

Search

Navigation