Abstract
Increasing solicitudes about security demand better, robust and effective solutions. Security cameras are playing a vital role in this regard and the surveillance technology is improving rapidly. However, these cameras are usually installed at obvious and visible locations which are often exploitable by the criminals either by hiding themselves from the camera, choosing an alternative path or deceiving the camera. This situation can be overcome to a large extent if the cameras are installed at hidden places looking through narrow regions, e.g. camera fixed inside the building and looking through the window curtain slits. However, this solution poses new challenges in terms of capturing the video through slits and accumulating the information to a meaningful view. In this paper we propose an effective and robust solution to this problem that automatically extracts the slit regions and merges them over a large number of frames to construct a panoramic view. Moreover, such a security surveillance system will be subjected to the sudden illumination variations. We effectively handle such variations by incorporating robustness in the proposed framework. A large number of experiments are performed on various indoor and outdoor real video sequences. The results demonstrate the effectiveness of the proposed framework. Experiments are also performed to objectively assess the perceptual quality of the resulting panoramic images. Our results are even better than the existing commercial software.
Similar content being viewed by others
References
Aach T, Dumbgen L, Mester R, Toth D (2001) Bayesian illumination-invariant motion detection. In: Proceedings of the international conference image process. (ICIP), vol 3, pp 640–643
Agaian S, Silver B, Panetta K (2007) Transform coefficient histogram-based image enhancement algorithms using contrast entropy. IEEE Trans Image Process 16 (3):741–758
Bergen J, Anandan P, Hanna K, Hingorani R (1992) Hierarchical model-based motion estimation. In: Proceedings 2nd European conference on computer vision, ECCV ’92. Springer, London, pp 237– 252
Chang CH, Sato Y, Chuang YY (2014) Shape-preserving half-projective warps for image stitching. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 3254–3261
Cristofaro A, Salaris P, Pallottino L, Giannoni F, Bicchi A (2014) On time-optimal trajectories for differential drive vehicles with field-of-view constraints. In: IEEE 53rd annual conference on decision and control (CDC), pp 2191–2197
Dornaika F, Chakik F (2012) Efficient object detection and tracking in video sequences. J Opt Soc Am A 29(6):928–935
Elibol A, Gracias N, Garcia R, Kim J (2014) Graph theory approach for match reduction in image mosaicing. J Opt Soc Am A 31(4):773–782
Farid M, Mahmood A (2012) Image morphing in frequency domain. J Math Imaging Vis 42(1):50–63
Farid M, Mahmood A (2014) An image composition algorithm for handling global visual effects. Multimed Tools Appl 71(3):1699–1716
Fu Z, Wang L (2014) Optimized design of automatic image mosaic. Multimed Tools Appl 72(1):503–514
Guizar-Sicairos M, Thurman ST, Fienup JR (2008) Efficient subpixel image registration algorithms. Opt Lett 33(2):156–158
Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings Alvey vision conference, pp 23.1–23.6
Hou J, Wu C, Yuan Z, Tan J, Wang Q, Zhou Y (2008) Research of intelligent home security surveillance system based on zigbee. In: International symposium on intelligent information technology application workshops, pp 554–557
Kosmopoulos DI, Doulamis ND, Voulodimos AS (2012) Bayesian filter based behavior recognition in workflows allowing for user feedback. Comput Vis Image Underst 116(3):422–434. Special issue on Semantic Understanding of Human Behaviors in Image Sequences
Li B, Wang W, Ye H (2013) Multi-sensor image registration based on algebraic projective invariants. Opt Express 21(8):9824–9838
Li X, Cheah CC (2015) Robotic cell manipulation using optical tweezers with unknown trapping stiffness and limited fov. IEEE/ASME Trans Mechatronics 20 (4):1624–1632
Lin WY, et al. (2011) Smoothly varying affine stitching. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 345–352
Litvinov A, Schechner YY (2005) Radiometric framework for image mosaicking. J Opt Soc Am A 22(5):839–848
Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Lu T, Li S, Fu W (2014) Fusion based seamless mosaic for remote sensing images. Sensing and Imaging 15(1):101
Microsoft Image Composite Editor. http://research.microsoft.com/ivm/ice/. Version 1.4.4.0
Monroe D (2003) Ground based security surveillance system for aircraft and other commercial vehicles. US Patent 6,545,601
Mubasher M, Farid M, Khaliq A, Yousaf M (2012) A parallel algorithm for change detection. In: Proceedings 15th international multitopic conference (INMIC), pp 201–208
Ng M, Wang W (2013) A variational approach for image stitching ii: using image gradients. SIAM J Imaging Sci 6(3):1345–1366
Phong B (1975) Illumination for computer generated pictures. Commun ACM 18(6):311–317
Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Carli M, Battisti F (2009) Tid2008-a database for evaluation of full-reference visual quality assessment metrics. Adv Mod Radioelectron 10(4):30–45
Prados R, Garcia R, Neumann L (2014) State of the art in image blending techniques. In: Image blending techniques and their application in underwater mosaicing. Springer, pp 35–60
Radke R, Andra S, Al-Kofahi O, Roysam B (2005) Image change detection algorithms: a systematic survey. IEEE Trans Image Process 14(3):294–307
Raty T (2010) Survey on contemporary remote surveillance systems for public safety. IEEE Trans Syst, Man, Cybern C 40(5):493–515
Shah M, Javed O, Shafique K (2007) Automated visual surveillance in realistic scenarios. IEEE Multimed 14(1):30–39
Silva F, Hiraga A, Artero A, Paiva M (2014) StitchingPHm-A new algorithm for panoramic images. Pattern Recog Image Anal 24(1):41–56
Srikantha A, Sidib D (2012) Ghost detection and removal for high dynamic range images: recent advances. Signal Process Image Commun 27(6):650–662
Suen ST, Lam EY, Wong KK (2007) Photographic stitching with optimized object and color matching based on image derivatives. Opt Express 15(12):7689–7696
Szwed P, Skrzynski P, Chmiel W (2014) Risk assessment for a video surveillance system based on fuzzy cognitive maps. Multimed Tools Appl:1–24
Uyttendaele M, Eden A, Skeliski R (2001) Eliminating ghosting and exposure artifacts in image mosaics. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR), vol 2, pp II–509
Wang W, Ng M (2012) A variational method for multiple-image blending. IEEE Trans Image Process 21(4):1809–1822
Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wu G, Wu Y, Jiao L, Wang YF, Chang EY (2003) Multi-camera spatio-temporal fusion and biased sequence-data learning for security surveillance. In: Proceedings of the ACM international conference on multimedia, pp 528–538
Xu Z (2013) Consistent image alignment for video mosaicing. Signal Image Video Process 7(1):129–135
Zagrouba E, Barhoumi W, Amri S (2009) An efficient image-mosaicing method based on multifeature matching. Mach Vis Appl 20(3):139–162
Zaragoza J, Chin TJ, Brown M, Suter D (2013) As-projective-as-possible image stitching with moving dlt. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 2339–2346
Zeng L, Zhang S, Zhang J, Zhang Y (2014) Dynamic image mosaic via sift and dynamic programming. Mach Vis Appl 25(5):1271–1282
Zeng L, Zhang W, Zhang S, Wang D (2014) Video image mosaic implement based on planar-mirror-based catadioptric system. Signal Image Video Process 8 (6):1007–1014
Zitov B, Flusser J (2003) Image registration methods: a survey. Image Vis Comput 21(11):977–1000
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tazeem, H., Farid, M.S. & Mahmood, A. Improving security surveillance by hidden cameras. Multimed Tools Appl 76, 2713–2732 (2017). https://doi.org/10.1007/s11042-016-3260-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-3260-2