Skip to main content

Global Motion Estimation Using Saliency Maps in Non-stationary Videos with Static Scenes

  • Conference paper
  • First Online:
Intelligent Interactive Multimedia Systems and Services 2016

Abstract

The global motion estimation is a cornerstone of successful video stabilization. In current research, the stabilization task of non-stationary video sequence with static scenes is solved using saliency maps and the trajectories of feature descriptors. First, the feature descriptors are built in keyframes with the removed regions of moving foreground objects, which are considered the salient objects. The tracking results of feature descriptors form the feature trajectories. Second, a distinctiveness of a short-term trajectory is evaluated by histogram approach. Third, a temporal coherence of a long-term trajectory is exploited to verify the global motion through a whole video sequence. In this research, the constant flow and the affine flow are considered. The proposed algorithm permits to increase the peak signal to noise ratio up 4–7 dB on the average comparing with conventional stabilization methods in video sequences with static scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pan, W.D., Yoo, S.-M., Nalasani, M., Cox, P.G.: Efficient local transformation estimation using Lie operators. Inf. Sci. 177(3), 815–831 (2007)

    Article  Google Scholar 

  2. Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2, 164–168 (1944)

    MathSciNet  MATH  Google Scholar 

  3. Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431–441 (1963)

    Article  MathSciNet  MATH  Google Scholar 

  4. Alzoubi, H., Pan, W.D.: Fast and accurate global motion estimation algorithm using pixel subsampling. Inf. Sci. 178(17), 3415–3425 (2008)

    Article  Google Scholar 

  5. Lee, K.-Y., Chuang, Y.-Y., Chen, B.-Y., Ouhyoung, M.: Video stabilization using robust feature trajectories. In: IEEE 12th International Conference on Computer Vision, pp. 1397–1404. IEEE Press, New York (2009)

    Google Scholar 

  6. Torii, A., Havlena, M., Pajdla, T.: Omnidirectional image stabilization by computing camera trajectory. In: Wada, T., Huang, F., Lin, S. (eds.) Advances in Image and Video. LNCS, vol. 5414, pp. 71–82. Springer, Berlin, Heidelberg (2009)

    Chapter  Google Scholar 

  7. Battiato, S., Gallo, G., Puglisi, G., Scellato, S.: SIFT features tracking for video stabilization. In: 14th International Conference on Image Analysis and Processing (ICIAP’2007), pp. 825–830. IEEE Press, New York (2007)

    Google Scholar 

  8. Huang, K.-Y., Tsai, Y.-M., Tsai, C.-C., Chen, L.-G.: Video stabilization for vehicular applications using SURF-like descriptor and KD-tree. In: 17th IEEE International Conference on Image Processing (ICIP’2010), pp. 3517–3520. IEEE Press, New York (2010)

    Google Scholar 

  9. Yang, J., Schonfeld, D., Mohamed, M.: Robust video stabilization based on particle filter tracking of projected camera motion. IEEE Trans. Circuits Syst. Video Technol. 19(7), 945–954 (2009)

    Article  Google Scholar 

  10. Xu, L., Lin, X.: Digital image stabilization based on circular block matching. IEEE Trans. Consum. Electron. 52(2), 566–574 (2006)

    Article  Google Scholar 

  11. Wang, C., Kim, J.-H., Byun, K.-Y., Ni, J., Ko, S.-J.: Robust digital image stabilization using the Kalman filter. IEEE Trans. Consum. Electron. 55(1), 6–14 (2009)

    Article  Google Scholar 

  12. Favorskaya, M., Buryachenko, V.: Fuzzy-based digital video stabilization in static scenes. In: Tsihrintzis, G.A., Virvou, M., Jain, L.C., Howlett, R.J., Watanabe, T. (eds.) Intelligent Interactive Multimedia Systems and Services in Practice, SIST, vol. 36, pp. 63–83. Springer International Publishing Switzerland (2015)

    Google Scholar 

  13. Ioannidis, K., Andreadis, I.: A digital image stabilization method based on the Hilbert-Huang transform. IEEE Trans. Instrum. Meas. 61(9), 2446–2457 (2012)

    Article  Google Scholar 

  14. Murray, D.W., Buxton, B.F.: Scene segmentation from visual motion using global optimization. IEEE Trans. Pattern Anal. Mach. Intell. 9(2), 220–228 (1987)

    Article  Google Scholar 

  15. Black, M.J., Anandan P.: Robust dynamic motion estimation over time. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 292–302. IEEE Computer Society Press, New York (1991)

    Google Scholar 

  16. Valgaerts, L., Bruhn, A., Zimmer, H., Weickert, J., Stoll, C., Theobalt C.: Joint estimation of motion, structure and geometry from stereo sequences. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) Computer Vision—ECCV’2010, LNCS, vol. 6314, pp. 568–581. Springer, Berlin (2010)

    Google Scholar 

  17. Favorskaya, M., Jain, L.C., Buryachenko, V.: Digital video stabilization in static and dynamic scenes. In: Favorskaya, M.N., Jain, L.C. (eds.) Computer Vision in Control Systems-1, ISRL, vol. 73, pp. 261–309. Springer International Publishing Switzerland (2015)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the Russian Fund for Basic Researches, grant no. 16-07-00121 A, Russian Federation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Margarita Favorskaya .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Favorskaya, M., Buryachenko, V., Tomilina, A. (2016). Global Motion Estimation Using Saliency Maps in Non-stationary Videos with Static Scenes. In: Pietro, G., Gallo, L., Howlett, R., Jain, L. (eds) Intelligent Interactive Multimedia Systems and Services 2016. Smart Innovation, Systems and Technologies, vol 55. Springer, Cham. https://doi.org/10.1007/978-3-319-39345-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-39345-2_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-39344-5

  • Online ISBN: 978-3-319-39345-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics