Abstract
In this paper, we propose a 2-step algorithm to reduce the lighting influences between frames in an image sequence. First, the lighting parameters of a perceptual lighting model are initialized using an entropy measure. Then the difference between two successive frames is used as a cost function for further optimization the above lighting parameters. By applying the proposed lighting model optimization on an image sequence, the neighboring frames become similar in brightness and contrast while features are enhanced. The effectiveness of the proposed approach is illustrated on the detection and tracking of facial features.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proc. International Conference on Computer Vision, pp. 1150–1157 (1999)
Schneiderman, H., Kanade, T.: A statistical method for 3d object detection applied to faces and cars. In: IEEE International Conference on Computer Vision, pp. 746–751 (2000)
Hou, Y., Sahli, H., Ravyse, I., Zhang, Y., Zhao, R.: Robust shape-based head tracking. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 340–351. Springer, Heidelberg (2007)
Xiao, R., Li, M., Zhang, H.: Robust multipose face detection in images. IEEE Trans. Circuits and Systems for video technology 12, 31–41 (2004)
Zhou, Y., Gu, L., Zhang, H.: Bayesian tangent shape model: estimating shape and pose parameters via bayesian inference. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 109–116 (2003)
Lee, J., Moghaddam, B., Pfister, H., Machiraju, R.: A bilinear illumination model for robust face recognition. In: Proc. IEEE International Conference on Computer Vision (2005)
Wang, Y., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face re-lighting from a single image under harsh lighting conditions. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition 2007 (2007)
Zhang, L., Wang, S., Samaras, D.: Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model. In: Proc. IEEE Conf. Computer Vision and Patter Recognition (2005)
Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 1025–1039 (1998)
Kale, A., Jaynes, C.: A joint illumination and shape model for visual tracking. In: Proceedings of Computer Vision and Pattern Recognition, pp. 602–609 (2006)
Xu, Y., Roy-Chowdhury, A.K.: Integrating motion, illumination, and structure in video sequences with applications in illumination-invariant tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 793–806 (2007)
Gross, R., Brajovic, V.: An image processing algorithm for illumination invariant face recognition. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 10–18. Springer, Heidelberg (2003)
Wang, H., Li, S., Wang, Y.: Generalized quotient image. In: IEEE Conf. Computer Vision and Pattern Recogniton, pp. 498–505 (2004)
Jiang, X., Sun, P., Xiao, R., Zhao, R.: Perception based lighting balance for face detection. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3852, pp. 531–540. Springer, Heidelberg (2006)
Liu, F., Gleicher, M.: Texture-consistent shadow removal. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 437–450. Springer, Heidelberg (2008)
Wang, Y.: Real-time moving vehicle detection with cast shadow removal in video based on conditional random field. IEEE Tran. on Circuits and Systems for Video Technology 19, 437–441 (2009)
Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visualization and Computer Graphics 11, 13–24 (2005)
Nelder, J.A., Mead, R.: A simplex method for function minimization. Computer Journal 7, 308–313 (1965)
Waltz, R.A., Morales, J.L., Nocedal, J., Orban, D.: An interior algorithm for nonlinear optimization that combines line search and trust region steps. Mathematical Programming 107, 391–408 (2006)
Sim, T., Baker, S., Bsat, M.: The cmu pose, illumination, and expression (pie) database. In: Processing of the IEEE International Conference on Automatic Face and Gesture Recognition (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, X. et al. (2010). Perception-Based Lighting Adjustment of Image Sequences. In: Zha, H., Taniguchi, Ri., Maybank, S. (eds) Computer Vision – ACCV 2009. ACCV 2009. Lecture Notes in Computer Science, vol 5996. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12297-2_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-12297-2_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12296-5
Online ISBN: 978-3-642-12297-2
eBook Packages: Computer ScienceComputer Science (R0)