Skip to main content
SpringerLink
Log in

Video stitching based on iterative hashing and dynamic seam-line with local context

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video stitching fuses multi-camera videos with differing centers of projection into a single panoramic video. Image registration and video fusion is the key of video stitching. In this paper, a robust and real-time video stitching method based on iterative hashing and best dynamic seam-line with local context model is proposed, which can eliminate ghosting and ensure real-time in video stitching. Firstly, the iterative hashing algorithm is proposed to improve the speed and precision of image registration. Image feature points are matched by constructing a multi-table, extracting candidates and refining candidates with iteration, which enhances the local sensitivity of hashing and speeds up the process of feature points matching. Secondly, the method of finding the best seam-line dynamically and blending with local context is proposed to improve the quality of video fusion. The proposed video fusion method is able to eliminate ghosting and illumination variation during video stitching. In addition, the speed of video stitching can be enhanced. Experimental results on several scenes show the efficiency and effectiveness of the proposed video stitching method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Brian Kulis T D (2009) Learning to hash with binary reconstructive embeddings. In: Proc. NIPS 2009, pp 1042–1050

  2. Cheng J, Leng C, Wu J, Cui H, Lu H (2014) Fast and accurate image matching with cascade hashing for 3d reconstruction. In: 2014 IEEE Conference on computer vision and pattern recognition (CVPR). IEEE, pp 1–8

  3. Christoph Strecha Alexander M Bronstein MMBPF (2010) Ldahash: Improved matching with smaller descriptors. IEEE Trans Pattern Anal Mach Intell 34(1):66–78

    Google Scholar 

  4. Cui J, An Z, Guo Y, Zhou S (2010) Efficient nearest neighbor query based on extended b+-tree in high-dimensional space. Pattern Recog Lett 31(12):1740–1748

    Article  Google Scholar 

  5. Duplaquet M L (1998) Building large image mosaics with invisible seam lines. Proc Spie 3387:369– 377

    Article  Google Scholar 

  6. Fischler M A, Bolles R C (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun Acm 24(6):381–395

    Article  MathSciNet  Google Scholar 

  7. Gionis A, Indyk P, Motwani R, et al. (1999) Similarity search in high dimensions via hashing. In: VLDB, vol 99, pp 518–529

  8. Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge university press

  9. Herbert Bay Andreas Ess TTLVG (2008) Speeded-up robust features (surf). Comput Vis Image Understand 110(3):346–359

    Article  Google Scholar 

  10. Ivanov Y, Bobick A, Liu J (2001) Fast lighting independent background subtraction. Int J Comput Vis 37(2):199–207

    Article  MATH  Google Scholar 

  11. J W (2012) Semi-supervised hashing for large-scale search. IEEE Trans Pattern Anal Mach Intell 34(12):2393–2406

    Article  Google Scholar 

  12. Lowe D G (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  13. Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 27(10):1615–1630

    Article  Google Scholar 

  14. Moran S, Lavrenko V, Osborne M (2013) Neighbourhood preserving quantisation for lsh. In: Proceedings of the 36th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 1009–1012

  15. Muja M, Lowe D G (2009) Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP 1:2

    Google Scholar 

  16. Muja M, Lowe D G (2014) Scalable nearest neighbor algorithms for high dimensional data. IEEE Trans Pattern Anal Mach Intell 36

  17. Pan J, Manocha D (2011) Fast gpu-based locality sensitive hashing for k-nearest neighbor computation. In: Proceedings of the 19th ACM SIGSPATIAL international conference on advances in geographic information systems. ACM, pp 211–220

  18. Pan P, Mitsushita T, Lin C, Kuo B (2011) Optimized video stitching method. US Patent 7,978, 931

  19. Ruslan Salakhutdinov G E H (2009) Semantic hashing. Int J Approx Reas 50 (7):969–978

    Article  Google Scholar 

  20. Shuicheng Yan Jialie Shen YM (2010) Weakly-supervised hashing in kernel space. In: 2012 IEEE Conference on computer vision and pattern recognition, pp 3344–3351

  21. Slaney M, Casey M (2008) Locality-sensitive hashing for finding nearest neighbors [lecture notes]. IEEE Signal Process Mag 25(2):128–131

    Article  Google Scholar 

  22. Tola E, Lepetit V, Fua P (2010) Daisy: an efficient dense descriptor applied to wide-baseline stereo. IEEE Trans Pattern Anal Mach Intell 32(5):815–830

    Article  Google Scholar 

  23. Wei Liu Jun Wang SfC (2011) Hashing with graphs. In: International conference on machine learning

  24. Weiss Y, Torralba A, Fergus R (2009) Spectral hashing. In: Advances in neural information processing systems, pp 1753–1760

  25. Xu W (2012) Panoramic video stitching. Ph.D. thesis, Boulder, CO, USA. AAI3549340

  26. Xu W, Mulligan J (2010) Performance evaluation of color correction approaches for automatic multi-view image and video stitching. In: 2010 IEEE Conference on computer vision and pattern recognition(CVPR), pp 263–270

  27. Yuan Z, Kebin J, Pengyu L (2009) Video stitch algorithm based on dynamic foreground extraction. In: 2nd International congress on image and signal processing, 2009. CISP’09. IEEE, pp 1–5

  28. Zaragoza J, Chin T J, Tran Q H, Brown M S, Suter D (2014) As-projective-as-possible image stitching with moving dlt. IEEE Trans Pattern Anal Mach Intell 36(7):1285–1298

    Article  Google Scholar 

  29. Zhang F, Liu F (2014) Parallax-tolerant image stitching. In: 2014 IEEE Conference on computer vision and pattern recognition (CVPR). IEEE, pp 3262–3269

Download references

Acknowledgments

The work is partially supported by National Natural Science Foundation of China (Grant No. 61402483, 61572505), China Postdoctoral Science Foundation (Grant No. 2014M551696), Postdoctoral Science Foundation of Jiangsu Province (Grant No. 1402057C), and the Prospective Integration of Industry, Education and Research Foundation of Jiangsu Province (Grant No. BY2015023-05).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, 221116, China

    Rui Yao, Jinliang Sun, Yong Zhou & Dai Chen

Authors
  1. Rui Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinliang Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dai Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rui Yao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yao, R., Sun, J., Zhou, Y. et al. Video stitching based on iterative hashing and dynamic seam-line with local context. Multimed Tools Appl 76, 13615–13631 (2017). https://doi.org/10.1007/s11042-016-3738-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3738-y

Keywords

Search

Navigation