Abstract
In insufficient indoor light conditions, when images of paintings, documents and objects with glossy surfaces are captured using flash light, bright annoying specularities appear in the image which not only degrade the aesthetic quality, but also lead to loss of useful information. In this paper, we address the problem of specular reflections in images of aforementioned scenes, captured using flash light. We propose a novel specular reflection detection algorithm which utilizes flash/no-flash image pair to accurately detect specular reflections in flash image, while ignoring the inherent bright regions. The detected specular reflections are seamlessly recovered using Poisson image editing technique. Quantitative as well as qualitative comparison of the proposed detection method on our flash/no-flash image dataset shows that it significantly outperforms other eminent methods in literature. We also implement our solution in an Android smartphone to demonstrate its effectiveness in real-life scenarios.
S. K. Das and K. Swami—Equal contribution.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agrawal, A., Raskar, R., Nayar, S.K., Li, Y.: Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Trans. Graph. 24(3), 828–835 (2005)
Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23(3), 664–672 (2004)
Kumar, J., Maltz, M., Bala, R.: Flash/no-flash fusion for mobile document image binarization. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 5871–5875, October 2014
Feris, R., Raskar, R., Tan, K.H., Turk, M.: Specular reflection reduction with multi-flash imaging. In: 17th Brazilian Symposium on Computer Graphics and Image Processing, Proceedings, pp. 316–321, October 2004
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)
He, S., Lau, R.W.H.: Saliency detection with flash and no-flash image pairs. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 110–124. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10578-9_8
Sun, J., Sun, J., Kang, S.B., Xu, Z.B., Tang, X., Shum, H.Y.: Flash cut: foreground extraction with flash and no-flash image pairs. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007
DiCarlo, J.M., Xiao, F., Wandell, B.A.: Illuminating illumination. In: Color and Imaging Conference, vol. 9, pp. 27–34. Society for Imaging Science and Technology (2001)
Lu, C., Drew, M.S.: Practical scene illuminant estimation via flash/no-flash pairs. In: Color and Imaging Conference, vol. 14, pp. 84–89. Society for Imaging Science and Technology (2006)
Hui, Z., Sankaranarayanan, A.C., Sunkavalli, K., Hadap, S.: White balance under mixed illumination using flash photography. In: 2016 IEEE International Conference on Computational Photography (ICCP), pp. 1–10, May 2016
Raskar, R., Tan, K.H., Feris, R., Yu, J., Turk, M.: Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. In: ACM SIGGRAPH 2004 Papers, SIGGRAPH 2004, pp. 679–688. ACM, New York (2004)
Zhuo, S., Guo, D., Sim, T.: Robust flash deblurring. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2440–2447, June 2010
Seo, H., Milanfar, P.: Computational photography using a pair of flash/no-flash images by iterative guided filtering. In: IEEE International Conference on Computer Vision (ICCV) (2011)
Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23(3), 673–678 (2004)
Artusi, A., Banterle, F., Chetverikov, D.: A survey of specularity removal methods. Comput. Graph. Forum 30(8), 2208–2230 (2011)
Nayar, S.K., Fang, X.S., Boult, T.: Separation of reflection components using color and polarization. Int. J. Comput. Vis. 21(3), 163–186 (1997)
Yang, Q., Wang, S., Ahuja, N., Yang, R.: A uniform framework for estimating illumination chromaticity, correspondence, and specular reflection. IEEE Trans. Image Process. 20(1), 53–63 (2011)
Tan, R.T., Ikeuchi, K.: Separating reflection components of textured surfaces using a single image. IEEE Trans. Pattern Anal. Mach. Intell. 27(2), 178–193 (2005)
Mallick, S.P., Zickler, T., Belhumeur, P.N., Kriegman, D.J.: Specularity removal in images and videos: a PDE approach. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 550–563. Springer, Heidelberg (2006). https://doi.org/10.1007/11744023_43
Yang, Q., Wang, S., Ahuja, N.: Real-time specular highlight removal using bilateral filtering. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 87–100. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_7
Yang, Q., Tang, J., Ahuja, N.: Efficient and robust specular highlight removal. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1304–1311 (2015)
Kim, H., Jin, H., Hadap, S., Kweon, I.: Specular reflection separation using dark channel prior. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1460–1467, June 2013
Akashi, Y., Okatani, T.: Separation of reflection components by sparse non-negative matrix factorization. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9007, pp. 611–625. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16814-2_40
Shen, H.L., Zhang, H.G., Shao, S.J., Xin, J.H.: Chromaticity-based separation of reflection components in a single image. Pattern Recogn. 41(8), 2461–2469 (2008)
Shen, H.L., Zheng, Z.H.: Real-time highlight removal using intensity ratio. Appl. Opt. 52(19), 4483–4493 (2013)
An, D., Suo, J., Ji, X., Wang, H., Dai, Q.: Fast and high quality highlight removal from a single image. CoRR abs/1512.00237 (2015)
Nguyen, T., Vo, Q., Kim, S., Yang, H., Lee, G.: A novel and effective method for specular detection and removal by tensor voting. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 1061–1065, October 2014
Park, J.B., Kak, A.C.: A truncated least squares approach to the detection of specular highlights in color images. In: IEEE International Conference on Robotics and Automation, Proceedings, ICRA 2003, vol. 1, pp. 1397–1403, September 2003
Rosenfeld, A.: Connectivity in digital pictures. J. ACM 17(1), 146–160 (1970)
Swami, K., Das, S.K., Khandelwal, G., Vijayvargiya, A.: A robust flash image shadow detection method and seamless recovery of shadow regions. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 2836–2841, December 2016
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006). https://doi.org/10.1007/11744023_34
Leutenegger, S., Chli, M., Siegwart, R.Y.: BRISK: binary robust invariant scalable keypoints. In: 2011 International Conference on Computer Vision, pp. 2548–2555, November 2011
Fischler, M.A., Bolles, R.C.: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981). (reprinted in readings in computer vision, ed. ma fischler)
Goutte, C., Gaussier, E.: A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In: Losada, D.E., Fernández-Luna, J.M. (eds.) ECIR 2005. LNCS, vol. 3408, pp. 345–359. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31865-1_25
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Das, S.K., Swami, K., Khandelwal, G., Thakkalapally, P.R. (2018). Near Real-Time Correction of Specular Reflections in Flash Images Using No-Flash Image Prior. In: Rameshan, R., Arora, C., Dutta Roy, S. (eds) Computer Vision, Pattern Recognition, Image Processing, and Graphics. NCVPRIPG 2017. Communications in Computer and Information Science, vol 841. Springer, Singapore. https://doi.org/10.1007/978-981-13-0020-2_16
Download citation
DOI: https://doi.org/10.1007/978-981-13-0020-2_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-0019-6
Online ISBN: 978-981-13-0020-2
eBook Packages: Computer ScienceComputer Science (R0)