Skip to main content
SpringerLink
Log in

A Joint Spatial-Temporal 3D Video Stabilization Algorithm

  • Conference paper
  • First Online:
Digital TV and Wireless Multimedia Communication (IFTC 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 685))

Abstract

This paper presents a 3D (Three dimensional) video stabilization algorithm combined with a joint spatial and temporal strategy. On the temporal axis, SURF (Speeded-Up Robust Features) are extracted from the consecutive frames and then motion parameters are estimated, with which we calibrate and compensate the video frames after smoothing the motion parameters using Kalman filtering. Then, on the spatial axis, a histogram statistics method based on the extracted features is applied to detect the vertical parallax between the two views. Adjustments are implemented only when the parallax is larger than the safety threshold, which is conducted through subjective assessment, to maintain the consistency of 3D videos. The experimental results have shown that the proposed method is effective to reduce the vertical instability and inconsistency between binocular views and improve the quality and comfortableness of 3D videos.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gleicher, M.L., Liu, F.: Re-cinematography: improving the camera dynamics of casual video. In: International Conference on Multimedia, pp. 27–36. ACM (2007)

    Google Scholar 

  2. Liu, S., Yuan, L., Tan, P., et al.: SteadyFlow: spatially smooth optical flow for video stabilization. In: Computer Vision and Pattern Recognition, pp. 4209–4216. IEEE (2014)

    Google Scholar 

  3. Battiato, S., Gallo, G., Puglisi, G., et al.: SIFT features tracking for video stabilization. In: International Conference on Image Analysis and Processing, pp. 825–830 (2007)

    Google Scholar 

  4. Chen, Y.H., Lin, H.Y.S., Su, C.W.: Full-frame video stabilization via sift feature matching. In: Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing. IEEE (2014)

    Google Scholar 

  5. He, M., Huang, C., Xiao, C., et al.: Digital video stabilization based on hybrid filtering. In: International Congress on Image and Signal Processing, pp. 94–98. IEEE (2014)

    Google Scholar 

  6. Matsushita, Y., Ofek, E., Tang, X., et al.: Full-frame video stabilization. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005, CVPR 2005, vol. 1, pp. 50–57 (2005)

    Google Scholar 

  7. Yu, H., Zhang, W.: Moving camera video stabilization based on Kalman filter and least squares fitting. In: Intelligent Control and Automation. IEEE (2015)

    Google Scholar 

  8. Kooi, F.L., Toet, A.: Visual comfort of binocular and 3D displays. Displays 25(2–3), 99–108 (2004)

    Article  Google Scholar 

  9. Liu, W.X., Chin, T.J.: Smooth globally warp locally: video stabilization using homography fields. In: International Conference on Digital Image Computing: Techniques and Applications. IEEE (2015)

    Google Scholar 

  10. Salunkhe, A.U., Jagtap, S.K.: A survey on an adaptive video stabilization with tone adjustment. In: International Conference on Computing Communication Control and Automation. IEEE (2015)

    Google Scholar 

  11. Liu, F., Niu, Y., Jin, H.: Joint subspace stabilization for stereoscopic video. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 73–80. IEEE (2013)

    Google Scholar 

  12. Goldstein, A., Fattal, R.: Video stabilization using epipolar geometry. ACM Trans. Graph. 32(5), 573–587 (2012)

    Google Scholar 

  13. Liu, S., Yuan, L., Tan, P., et al.: Bundled camera paths for video stabilization. ACM Trans. Graph. 32(4), 96 (2013)

    Google Scholar 

  14. Song, J., Ma, X.: A novel real-time digital video stabilization algorithm based on the improved diamond search and modified Kalman filter 91–95 (2015)

    Google Scholar 

  15. Pinto, B., Anurenjan, P.R.: Video stabilization using speeded up robust features. In: 2011 International Conference on Communications and Signal Processing (ICCSP), pp. 527–531. IEEE (2011)

    Google Scholar 

  16. Mayen, K., Espinoza, C., Romero, H., et al.: Real-time video stabilization algorithm based on efficient block matching for UAVs. In: The Workshop on Research, Education and Development of Unmanned Aerial Systems. IEEE (2015)

    Google Scholar 

  17. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgment

This work was supported in part by the National Natural Science Foundation of China, under Grants 61571285, and U1301257. The work is also supported by the 2016 peak discipline of filmology of Shanghai University.

Author information

Authors and Affiliations

  1. School of Communication and Information Engineering, Shanghai University, Shanghai, 200072, China

    Jie Zhou, Zhixiang You, Ping An & Tengyue Du

  2. China Aeronautical Radio Electronics Research Institute, Shanghai, 200233, China

    Xinliang Wu

Authors
  1. Jie Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhixiang You
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ping An
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xinliang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tengyue Du
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ping An .

Editor information

Editors and Affiliations

  1. Shanghai Jiao Tong University, Shanghai, China

    Xiaokang Yang

  2. Shanghai Jiao Tong University, Shanghai, China

    Guangtao Zhai

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Zhou, J., You, Z., An, P., Wu, X., Du, T. (2017). A Joint Spatial-Temporal 3D Video Stabilization Algorithm. In: Yang, X., Zhai, G. (eds) Digital TV and Wireless Multimedia Communication. IFTC 2016. Communications in Computer and Information Science, vol 685. Springer, Singapore. https://doi.org/10.1007/978-981-10-4211-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4211-9_8

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4210-2

  • Online ISBN: 978-981-10-4211-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation