Abstract
As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bay H, Ess A, Tuytelaars T, Gool LV (2008) Speeded-up robust features (surf). Comput Vis Image Underst 110(3):346
Bosco A, Bruna A, Battiato S, Bella G, Puglisi G (2008) Digital video stabilization through curve warping techniques. IEEE Trans Consumer Electron 54(2):220
Erturk S (2002) Real-time digital image stabilization using kalman filters. Real-Time Imag 8(4):317
Favorskaya MN, Jain LC, Buryachenko V (2014) Computer vision in control systems. Springer, Berlin
Forsyth DA, Ponce J (2002) Computer vision: a modern approach. Prentice Hall, Upper Saddle River
Grundmann M, Kwatra V, Essa I (2011) Auto-directed video stabilization with robust l1 optimal camera paths. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 225–232
Hadawale N, Nair S, Ukirde N, Andre SB (2018) Real time implementation of video stabilization. Int J Current Tredns Sci Technol 8(1):182
He J, Zhang D, Balzano L, Tao T (2014) Iterative grassmannian optimization for robust image alignment. Image Vis Comput 32(10):800
Jeon S, Yoon I, Yang S, Kim B, Kim J (2016) Robust feature detection using particle keypoints and its application to video stabilization in a consumer handheld camera. In: IEEE international conference on consumer electronics (ICCE), pp 217–218
Kang T, Choi I, Lim MT (2015) Mdghm-surf: a robust local image descriptor based on modified discrete gaussian-hermite moment. Pattern Recogn 48(3):670
Kang T, Zhang H, Kim D, Park G (2012) Enhanced sift descriptor based on modified discrete gaussian–hermite moment. ETRI J 34(4):572
Kim SK, Kang SJ, Wang TS, Ko SJ (2013) Feature point classification based global motion estimation for video stabilization. IEEE Trans Consumer Electron 59(1):267
Kim SW, Yin S, Yun K, Choi JY (2014) Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization. Comput Vis Image Underst 118:71
Kir B, Kurt M, Urhan O (2015) Local binary pattern based fast digital image stabilization. IEEE Signal Process Lett 22(3):341
Kumar V, Mukherjee J, Mandal SKD (2016) Image inpainting through metric labeling via guided patch mixing. IEEE Trans Image Process 25(11):5212
Lee TH, Lee YG, Song BC (2014) Fast 3d video stabilizatoin using roi-based warping. J Vis Commun Image Represent 25(5):943
Li D, Wang Z (2017) Video superresolution via motion compensation and deep residual learning. IEEE Trans Comput Imag 3(4):749
Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91
Luo M, Chang X, Li Z, Nie L, Mauptmann AG, Zheng Q (2017) Simple to complex cross-model learning to rank. Comput Vis Image Underst 163:67
Ma Z, Chang X, Xu Z, Sebe N, Hauptmann AG (2018) Joint attributes and event analysis for multimedia event detection. IEEE Trans Neural Netw Learn Syst 29(7):2921
Okade M, Biswas PK (2014) Improving video stabilization using multi-resolution mser features. IETE J Res 60(5):373
Puglisi G, Battiato S (2011) A robust image alignment algorithm for video stabilization purposes. IEEE Trans Circuit Syst Video Technol 21(10):1390
Wang S, Chang X, Li X, Long G, Yao L, Sheng QZ (2016) Diagnosis code assignment using sparsity-based disease correlation embedding. IEEE Trans Knowl Data Eng 28(12):3191
Xu J, Chang H, Yang S, Wang M (2012) Fast feature-based video stabilization without accumulative global motion estimation. IEEE Trans Consumer Electron 58 (3):993
Yang J, Schonfeld D, Mohamed M (2009) Robust video stabilization based on particle filter tracking of projected camera motion. IEEE Trans Circuit Syst Video Technol 19(7):945
Yeni AA, Erturk S (2005) Fast digital image stabilization using one bit transform based sub-image motion estimation. IEEE Trans Consumer Electron 51(3):917
Acknowledgements
This paper is supported by Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education under Grant (NRF-2016R1D1A1B01016071), and Residential Environment Research Program through the Infrastructure and Transport of Korean government funded by Ministry of Land under a grant(14RERP-B082204-01).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Pae, D.S., An, C.G., Kang, T.K. et al. Advanced digital image stabilization using similarity-constrained optimization. Multimed Tools Appl 78, 16489–16506 (2019). https://doi.org/10.1007/s11042-018-6932-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6932-2