Abstract
Night video enhancement techniques are widely used for identifying suspicious activities captured by night visual surveillance systems. However, artificial light sources present in the surroundings deteriorate the visual quality of the video captured during night. This non-uniform illumination reduces the object identification and tracking capability of a real-time visual security system. Thus, a uniform enhancement technique is insufficient for handling such uneven illumination. In this paper, we propose a novel night video enhancement scheme based on a hierarchical self-organizing network. This proposed scheme automatically groups and enhances the neighboring pixels of dark and light regions in each frame. In this scheme, two-level self- organizing neural networks were hierarchically arranged to group similar pixels present in the night video frame. We applied the no-reference-based performance evaluation metrics for measuring the objective quality of the video. The experimental results showed that our proposed approach considerably enhances the visual perception of the video captured at night under varied illumination conditions.
Similar content being viewed by others
References
Łoza, A., Bull, D.R., Hill, P.R., Achim, A.M.: Automatic contrast enhancement of low-light images based on local statistics of wavelet coefficients. Digit. Signal Proc. 23(6), 1856–1866 (2013)
Xu, Q., Jiang, H., Scopigno, R., Sbert, M.: A novel approach for enhancing very dark image sequences. Sig. Process. 103, 309–330 (2014)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising with block-matching and 3d filtering. Electronic Imaging pp. 606414–606414 (2006)
McCann, J., Funt, B., Ciurea, F.: Retinex in matlab. Proc. IS&T/SID 8th Color Imaging Conf pp. 112–121 (2000)
Wu, Y., Sun, Y., Zhang, H.: A fast video illumination enhancement method based on simplified vec model. Procedia Eng. 29, 3668–3673 (2012)
Rao, Y., Lin, W., Chen, L.: Image-based fusion for video enhancement of night-time surveillance. Opt. Eng. 49(12), 120501–120501 (2010)
Li, J., Li, S.Z., Pan, Q., Yang, T.: Illumination and motion-based video enhancement for night surveillance. 2nd Joint IEEE International workshop on visual surveillance and performance evaluation of tracking and surveillance pp. 169–175 (2005)
Yamasaki, A., Takauji, H., Kaneko, S., Kanade, T., Ohki, H.: Denighting: Enhancement of nighttime images for a surveillance camera. 19th International conference on pattern recognition (ICPR) pp. 1–4 (2008)
Soumya, T., Thampi, S.M.: Day color transfer based night video enhancement for surveillance system. IEEE Int. Conf. Signal Proc. Inf. Commun. Energy Syst. 1, 1–5 (2015)
Rao, Y., Hou, L., Wang, Z., Chen, L.: Illumination-based nighttime video contrast enhancement using genetic algorithm. Multim. Tools Appl. 70(3), 2235–2254 (2014)
Kohonen, T.: The self-organizing map. Proc. IEEE 78(9), 1464–1480 (1990)
Maddalena, L., Petrosino, A.: A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans. Image Process. 17(7), 1168–1177 (2008)
Palomo, E.J., Domínguez, E.: Hierarchical color quantization based on self-organization. J. Math. Imag. Vision 49(1), 1–19 (2014)
Chouhan, R., Jha, R.K., Biswas, P.K.: Enhancement of dark and low-contrast images using dynamic stochastic resonance. IET Image Proc. 7(2), 174–184 (2013)
Chen, S., He, Z., Grant, P.M.: Artificial neural network visual model for image quality enhancement. Neurocomputing 30(1), 339–346 (2000)
Zhang, J., Huang, C., Lu, J.: Image adaptive enhancement strategy based on neural network. In: Proceedings of the 2nd international conference on computer science and electronics engineering. Atlantis Press (2013)
Chua, K.K., Tay, Y.H.: Enhanced image super-resolution technique using convolutional neural network. In: Advances in visual informatics, pp. 157–164. Springer (2013)
Haritopoulos, M., Yin, H., Allinson, N.M.: Self-organizing map applied to image denoising. 12th IEEE Workshop on neural networks for signal processing pp. 525–534 (2002)
Dekker, A.H.: Kohonen neural networks for optimal colour quantization. Netw. Comput. Neural Syst. 5(3), 351–367 (1994)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)
Mittal, A., Soundararajan, R., Bovik, A.C.: Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)
Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)
Moorthy, A.K., Bovik, A.C.: A two-step framework for constructing blind image quality indices. IEEE Signal Process. Lett. 17(5), 513–516 (2010)
Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of jpeg compressed images. International Conference on Image Processing 1, I-477 (2002)
Acknowledgments
The authors would like to thank the Centre for Engineering Research and Development, Government of Kerala, for research fellowship and Tao Yang for sharing databases.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Soumya, T., Thampi, S.M. Self-organized night video enhancement for surveillance systems. SIViP 11, 57–64 (2017). https://doi.org/10.1007/s11760-016-0893-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-016-0893-6