Srimath Tirumala Sreyas
ABSTRACT
A system capable of demonstrating surveillance of a vast area for target tracking in real time has been a challenging problem and in this paper we present architecture for a real time, mosaicing and change detection system which proves to be an efficient solution for the same. A method of pipelining SURF (Speeded Up Robust Features) has been proposed for performing real time registration to generate panoramic view of a very large scene at far away distances. The pipelined architecture of the proposed system performs the computationally intensive SURF registration over 6 times faster than conventional SURF without any significant compromise in accuracy. The atmospheric turbulence may restrict accurate registration of images therefore a solution has been proposed which performs atmospheric turbulence restoration. Spatial information based object detection and tracking of slow moving objects in the mosaics of large areas is performed which ensures robust and accurate detection of changes in the scene. The proposed system works for large range PTZ cameras with both TI and CCD sensors in real world conditions, with fast panning and vast area of monitoring giving high target detection accuracy. The experimentation has been performed on varied datasets of both CCD and TI sensors and in different environmental conditions for both day and night scenarios. It has been observed from the experimental result that the proposed system outperforms similar systems such as [1, 13, 10] in terms of robustness, ability to handle diverse environments and overall system performance.
- P. Azzari. An effective real-time mosaicing algorithm apt to detect motion through background subtraction using a ptz camera. In AVSS Conference Proceedings, 2005.Google Scholar
- M. Brown and D. Lowe. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, pages 59--73, May 2007. Google ScholarDigital Library
- L. Bruzzone and D. Prieto. Automatic analysis of the difference image for unsupervised change detection. In IEEE Transactions on Geosciences and Remote sensing, May 2000.Google Scholar
- E. B. D. Lu, P. Mausel and E. Moran. Change detection techniques. May 2000.Google Scholar
- C. Evans. Notes on the opensurf library. Technical Report CSTR-09-001, January 2009.Google Scholar
- M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. In Communications of the ACM, June 1981. Google ScholarDigital Library
- O. K. Gruen A. and P. Agouris. Automatic extraction of man-made objects from aerial and space images. Google ScholarDigital Library
- C. Harris and M. Stephans. A combined corner and edge detector. In Fourth Alvey Vision Conference Proceedings, 1988.Google ScholarCross Ref
- T. T. Herbert Bay and L. V. Gool. Surf: speeded up robust features. In ECCV conference proceedings, 2006. Google ScholarDigital Library
- J.-S. Hu and T.-M. Su. Robust environmental change detection using ptz camera via spatial-temporal probabilistic modeling. IEEE Transactions on Mechatronics, June 2007.Google ScholarCross Ref
- L. Juan and O. Gwun. A comparison of sift, pca-sift and surf. IJIP, 2009.Google Scholar
- C. S. K. Mikolajczyk. Indexing based on scale invariant interest points. In Proceedings of ICCV, 2001.Google ScholarCross Ref
- S. Kang, J. Paikab, A. Koschana, B. Abidia, and M. A. Abidia. Real time video tracking using ptz cameras. In SPIE Conference Proceedings, pages 103--111, May 2003.Google ScholarCross Ref
- T. Kasetkasem and P. Varshney. An image change detection algorithm based on markov random field models. In IEEE Transactions on Geosciences and Remote sensing, Aug 2002.Google Scholar
- M. Lalonde, S. Foucher, L. Gagnon, E. Pronovost, M. Derenne, and A. Janelle. A system to automatically track humans and vehicles with a ptz camera. In Proceedings of SPIE, June 2007.Google Scholar
- J. Liu and J. Sun. Parallel graph-cuts by adaptive bottom-up merging. In Proceedings of CVPR, 2010.Google Scholar
- D. G. Lowe. Distinctive image features from scale-invariant key points (sift). IJCV, 2004. Google ScholarDigital Library
- R. B. N. Xu and N. Ahuja. Object segmentation using graph cuts based active contours. In Proceedings of IEEE Conference on CVPR, 2003.Google Scholar
- R. Radke, S. Andra, O. Al-Kofahi, and B. Roysam. Image change detection algorithms: a systematic survey. In IEEE Transactions on Image Processing, 2005. Google ScholarDigital Library
- V. Rankov, R. J. Locke, R. J. Edens, P. R. Barber, and B. Vojnovic. An algorithm for image stitching and blending. In Proceedings of SPIE, March 2005.Google Scholar
- E. Rosten and T. Drummond. Machine learning for high-speed corner detection. In Proceedings of ECCV, 2006. Google ScholarDigital Library
- D. Rueckert, L. I. Sonoda, C. Hayes, D. L. G. Hil, M. O. Leach, and D. J. Hawkes. Nonrigid registration using free-form deformations: Application to breast mr images. IEEE Transactions on Medical Imaging, 18(8), Aug 1999.Google ScholarCross Ref
- M. C. Stefan Leutenegger and R. Y. Siegwart. Brisk: Binary robust invariant scalable keypoints. In ICCV conference proceedings, November 2011. Google ScholarDigital Library
- H. S. T. Itoh and Y. Watanabe. Motion compensation for isar via centroid tracking. In IEEE Transactions on Aerospace and Electronic Systems, July 1996.Google Scholar
- P. M. Xiang Zhu. Removing atmospheric turbulence via space-invariant deconvolution. In IEEE Transactions on PAMI, April 2012. Google ScholarDigital Library
Index Terms
- Real time mosaicing and change detection system
Recommendations
Drift-Free Real-Time Sequential Mosaicing
We present a sequential mosaicing algorithm for a calibrated rotating camera which can for the first time build drift-free, consistent spherical mosaics in real-time, automatically and seamlessly even when previously viewed parts of the scene are re-...
Disparity Map Refinement for Video Based Scene Change Detection Using a Mobile Stereo Camera Platform
ICPR '10: Proceedings of the 2010 20th International Conference on Pattern RecognitionThis paper presents a novel disparity map refinement method and vision based surveillance framework for the task of detecting objects of interest in dynamic outdoor environments from two stereo video sequences taken at different times and from different ...
Real-Time Stereo Mosaicing Using Feature Tracking
ISM '11: Proceedings of the 2011 IEEE International Symposium on MultimediaReal-time creation of video mosaics needs fast and accurate motion computation. While most mosaicing methods can use 2D image motion, the creation of multi view stereo mosaics needs more accurate 3D motion computation. Fast and accurate computation of ...
Comments