Skip to main content
Springer Nature Link
Log in

Developing a new approach for registering LWIR and MWIR images using local transformation function

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In fusion of multi-sensor images, the first step is to geometrically align images taken by different sensors. In this paper, a new approach is proposed to register images of two different infrared spectral bands. Regarding some distortion parameters, local weighted mean approximation function is used as a locally sensitive transformation function to register the images. The first, local maximum gradients in Canny edges of the reference image are used as first group of control points. Then by assumption of knowing the maximum displacement of two images, an area of radius equal to maximum displacement around each point of first group in the target image is searched to find corresponding point in the second image. Gradient normalized mutual information is used as a similarity measure for comparing neighborhood regions of points. To evaluate the performance of this approach, images that have been taken by two separate infrared video cameras, one in long-wavelength infrared and the other in mid-wavelength infrared spectral band, are registered. The results show that our approach has better performance compared with approaches that use global transformation function.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Schreer, O., Saenz, M.L., Peppermuller, C., Hierl, T., Bachmann, K., Clement, D., Fries, J.: Helicopter-borne dual-band dual-FPA system (Proceedings Paper). In: Proceedings of SPIE, vol. 5074, pp. 637–647 (2003)

  2. Muller, M., Schreer, O., Saenz, M.L.: Real-time image processing and fusion for a new high-speed dual-band infrared camera. In: Proceedings of SPIE, vol. 6543 (2007)

  3. Irani, M., Anandan, P.: Robust multi-sensor image alignment. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 959–966 (1998)

  4. Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., Suetens, P.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16, 187–198 (1997)

    Article  Google Scholar 

  5. Studholme, C., Hill, D.L.G., Hawkes, D.J.: An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 32, 71–86 (1999)

    Article  Google Scholar 

  6. Kim, K.S., Lee, J.H., Ra, J.B.: Robust multi-sensor image registrationby enhancing statistical correlation, In: IEEE 7th International Conference on Information Fusion (FUSION), p. 7 (2005)

  7. Pluim, J.P.W., Maintz, J.B.A., Viergever, M.A.: Image registration by maximization of combined mutual information and gradient information. IEEE Trans. Med. Imaging 19, 809–814 (2000)

    Article  Google Scholar 

  8. Kim, Y.S., Lee, J.H., Ra, J.B.: Multi-sensor image registration based on intensity and edge orientation information. Pattern Recognit. 41, 3356–3365 (2008)

    Article  MATH  Google Scholar 

  9. Lee, J.H., Kim, Y.S., Lee, D., Kang, D.G., Ra, J.B.: Robust CCD and IR image registration using gradient-based statistical information. IEEE Signal Process. Lett. 17, 347–350 (2010)

    Article  Google Scholar 

  10. Jinsha, Y., Zhenbing, Z., Qiang, G., Jie, D., Meng, L.: Multimodal image registration based on empirical mode decomposition and mutual information. Chin. J. Sci. Instrum. 30, 2076–2081 (2009)

    Google Scholar 

  11. Zhang, X., Men, T., Liu, C., Yang, J.: Infrared and visible images registration using BEMD and MI. In: IEEE 3rd International Conference on Computer Science and Information Technology (ICCSIT), pp. 644–647 (2010)

  12. Jinga, J., Xuesong, Z.: Multi-sensor image automatic registration using mutual information. Energy Procedia 11, 552–559 (2011)

    Google Scholar 

  13. Istenic, R., Heric, D., Ribaric, S., Zazula, D.: Thermal and visual image registration in hough parameter space. In: 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services, pp. 106–109 (2007)

  14. Aling, T., Zhenbing, Z., Qiang, G.: Electrical equipment IR and visible images registration method based on SIFT. Electric Power Sci. Eng. 24, 13–15 (2008)

    Google Scholar 

  15. Wang, B., Wu, D., Xu, W.: A new image registration method for infrared images and visible images. In: IEEE 3rd International Congress on Image and, Signal Processing (CISP2010), pp. 1745–1749 (2010)

  16. Zhao, Z., Wang, R.: A method of infrared/visible image matching based on edge extraction. In: IEEE 3rd International Congress on Image and, Signal Processing (CISP2010), pp. 871–874 (2010)

  17. Richards, J.A., Jia, X.: Remote Sensing Digital Image Analysis: An Introduction, 3rd edn. Springer, New York (1999)

    Book  Google Scholar 

  18. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679–698 (1986)

    Article  Google Scholar 

  19. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with application to image automated cartography. Commun. ACM 24, 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  20. Goshtasby, A.: Piecewise linear mapping functions for image registration. Pattern Recognit. 19, 459–466 (1986)

    Article  Google Scholar 

  21. Goshtasby, A.: Piecewise cubic mapping functions for image registration. Pattern Recognit. 20, 525–533 (1987)

    Article  Google Scholar 

  22. Goshtasby, A.: Image registration by local approximation methods. Image Vis. Comput. 6, 255–261 (1988)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran

    H. Keshavarz & M. Azami

  2. Nuclear Engineering Department, Radiation Researching Center,School of Mechanical Engineering, Shiraz University, Shiraz, Iran

    R. Faghihi

  3. Department of Electronic and Computer Engineering, School of Engineering, Shiraz University, Shiraz, Iran

    F. Tajeripour

Authors
  1. H. Keshavarz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. Tajeripour
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Faghihi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Azami
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to H. Keshavarz.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Keshavarz, H., Tajeripour, F., Faghihi, R. et al. Developing a new approach for registering LWIR and MWIR images using local transformation function. SIViP 9, 29–37 (2015). https://doi.org/10.1007/s11760-012-0418-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0418-x

Keywords

Search

Navigation