Skip to main content
Springer Nature Link
Log in

Direct Image Alignment for Active Near Infrared Image Differencing

  • Conference paper
  • First Online:
Advanced Concepts for Intelligent Vision Systems (ACIVS 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9386))

  • 2917 Accesses

Abstract

One of the difficult challenges in face recognition is dealing with the illumination variations that occur in varying environments. A practical and efficient way to address harsh illumination variations is to use active image differencing in near-infrared frequency range. In this method, two types of image frames are taken: an illuminated frame is taken with near infrared illumination, and an ambient frame is taken without the illumination. The difference between face regions of these frames reveals the face image illuminated only by the illumination. Therefore the image is not affected by the ambient illumination and illumination robust face recognition can be achieved. But the method assumes that there is no motion between two frames. Faces in different locations on the two frames introduces a motion artifact. To compensate for motion between two frames, a motion interpolation method has been proposed; but it has limitations, including an assumption that the face motion is linear. In this paper, we propose a new image alignment method that directly aligns the actively illuminated and ambient frames. The method is based on Lucas-Kanade parametric image alignment method and involves a new definition of errors based on the properties of the two types of frames. Experimental results show that the direct method outperforms the motion interpolation method in terms of face recognition rates.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Agrawal, A., Raskar, R., Nayar, S.K., Li, Y.: Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Transactions on Graphics 24(3), 828–835 (2005)

    Article  Google Scholar 

  2. Baker, S., Matthews, I.: Lucas-Kanade 20 years on: A unifying framework. International Journal of Computer Vision 56(3), 221–255 (2004)

    Article  Google Scholar 

  3. Belhumeur, P., Hespanha, J., Kriegman, D., et al.: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)

    Article  Google Scholar 

  4. Black, M.J., Anandan, P.: The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding 63(1), 75–104 (1996)

    Article  Google Scholar 

  5. DiCarlo, J.M., Xiao, F., Wandell, B.A.: Illuminating illumination. In: Color and Imaging Conference, vol. 2001, pp. 27–34. Society for Imaging Science and Technology (2001)

    Google Scholar 

  6. Drew, M.S., Lu, C., Finlayson, G.D.: Removing shadows using flash/noflash image edges. In: IEEE International Conference on Multimedia and Expo, pp. 257–260. IEEE (2006)

    Google Scholar 

  7. Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23(3), 673–678 (2004)

    Article  Google Scholar 

  8. Hizem, W., Krichen, E., Ni, Y., Dorizzi, B., Garcia-Salicetti, S.: Specific sensors for face recognition. In: Zhang, D., Jain, A.K. (eds.) ICB 2005. LNCS, vol. 3832, pp. 47–54. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  9. Kang, J., Hayes III, M.H.: Face recognition for vehicle personalization with near-IR frame differencing and pose clustering. In: IEEE International Conference on Consumer Electronics, pp. 455–456. IEEE (2015)

    Google Scholar 

  10. Li, S., Chu, R., Liao, S., Zhang, L.: Illumination Invariant Face Recognition Using Near-Infrared Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(4), 627–639 (2007)

    Article  Google Scholar 

  11. Li, W., Zhang, J., Dai, Q.: Robust blind motion deblurring using near-infrared flash image. Journal of Visual Communication and Image Representation 24(8), 1394–1413 (2013)

    Article  Google Scholar 

  12. Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of International Conference on Image Processing, vol. 1, p. I-900. IEEE (2002)

    Google Scholar 

  13. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. International Joint Conference on Artificial Intelligence 81, 674–679 (1981)

    Google Scholar 

  14. Mikami, T., Sugimura, D., Hamamoto, T.: Capturing color and near-infrared images with different exposure times for image enhancement under extremely low-light scene. In: IEEE International Conference on Image Processing, pp. 669–673. IEEE (2014)

    Google Scholar 

  15. Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics 23(3), 664–672 (2004)

    Article  Google Scholar 

  16. Seo, H.J., Milanfar, P.: Iteratively merging information from a pair of flash/no-flash images using nonlinear diffusion. In: IEEE International Conference on Computer Vision Workshops, pp. 1324–1331. IEEE (2011)

    Google Scholar 

  17. Sun, J., Sun, J., Kang, S.B., Xu, Z.B., Tang, X., Shum, H.Y.: Flash cut: foreground extraction with flash and no-flash image pairs. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2007)

    Google Scholar 

  18. Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)

    Article  Google Scholar 

  19. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of Computer Vision and Pattern Recognition, vol. 1, p. I-511. IEEE (2001)

    Google Scholar 

  20. Yi, D., Liu, R., Chu, R.F., Wang, R., Liu, D., Li, S.Z.: Outdoor face recognition using enhanced near infrared imaging. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 415–423. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  21. Yoon, S.M., Lee, Y.J., Yoon, G.J., Yoon, J.: Adaptive total variation minimization-based image enhancement from flash and no-flash pairs. The Scientific World Journal 2014 (2014)

    Google Scholar 

  22. Zhuo, S., Guo, D., Sim, T.: Robust flash deblurring. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2440–2447. IEEE (2010)

    Google Scholar 

  23. Zou, X., Kittler, J., Messer, K.: Ambient illumination variation removal by active near-IR imaging. In: Zhang, D., Jain, A.K. (eds.) ICB 2005. LNCS, vol. 3832, pp. 19–25. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  24. Zou, X., Kittler, J., Messer, K.: Motion compensation for face recognition based on active differential imaging. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 39–48. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Georgia Institute of Technology, Atlanta, GA, 30332, USA

    Jinwoo Kang & David V. Anderson

  2. George Mason University, Fairfax, VA, 22030, USA

    Monson H. Hayes

Authors
  1. Jinwoo Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David V. Anderson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Monson H. Hayes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jinwoo Kang .

Editor information

Editors and Affiliations

  1. Dipartimento di Matematica e Informatica, Università di Catania, Catania, Catania, Italy

    Sebastiano Battiato

  2. Arcueil CX, France

    Jacques Blanc-Talon

  3. Catania, Italy

    Giovanni Gallo

  4. Gent, Belgium

    Wilfried Philips

  5. CSIRO, Sydney, New South Wales, Australia

    Dan Popescu

  6. Vision Lab., University of Antwerp, Antwerpen, Belgium

    Paul Scheunders

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Kang, J., Anderson, D.V., Hayes, M.H. (2015). Direct Image Alignment for Active Near Infrared Image Differencing. In: Battiato, S., Blanc-Talon, J., Gallo, G., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2015. Lecture Notes in Computer Science(), vol 9386. Springer, Cham. https://doi.org/10.1007/978-3-319-25903-1_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25903-1_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25902-4

  • Online ISBN: 978-3-319-25903-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics