Abstract
This paper concern the problem of ghosting caused by parallax and moving objects in image stitching. Previous approaches have used local homography or optimal seam lines to avoid ghosting. In this work, we propose an image stitching method based on fuzzy inference. At first, our use of the contrast limited adaptive histogram equalization (CLAHE) increase the matching points of the object surface in the low-contrast images. Then, to reduce the number of mismatching points, we combine the orientation of feature points to improve the zero-mean normalized cross-correlation (ZNCC) for filter matching points. Furthermore, by viewing the distance weight and gray difference of pixels in overlapping region as the first input and the second input of fuzzy inference respectively, and regarding the output of the fuzzy inference as the weight of image fusion. We generate high-quality stitching images. The experimental results show that our approach can reduce the ghosting phenomenon and improve the quality of the stitching.
Similar content being viewed by others
References
Adwan S, Alsaleh I, Majed R (2016) A new approach for image stitching technique using Dynamic Time Warping (DTW) algorithm towards scoliosis X-ray diagnosis. Measurement 84:32–46
Bay H, Tuytelaars T, Van Gool L (2006) Surf: Speeded up robust features. In: Proceedings 9th European conference computer vision, pp 404–417
Brown M, Lowe DG (2007) Automatic panoramic image stitching using invariant features. Int J Comput Vis 74(1):59–73
Chang CH, Sato Y, Chuang YY (2014) Shape-preserving half-projective warps for image stitching. In: Proceedings IEEE Conference on Computer Vision Pattern Recognition, pp 3254–3261
Dame A, Marchand E (2012) Second-order optimization of mutual information for real-time image registration. IEEE Trans Image Process 21(9):4190–4203
Davis J (1998) Mosaics of scenes with moving objects. In: Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 354–360
Duplaquet ML (1998) Building large image mosaics with invisible seam lines. In: Proceedings Visual Information Processing VII, pp 369–377
Fang F, Wang T, Fang Y, Zhang G (2019) Fast color blending for seamless image stitching. IEEE Geosci Remote Sens Lett 16(7):1115–1119
Gao J, Kim SJ, Brown MS (2011) Constructing image panoramas using dual-homography warping. In: Proceedings of the 2011 IEEE conference on computer vision and pattern recognition, pp 49–56
Harris CG, Stephens M (1988) A combined corner and edge detector. In: Alvey vision conference, pp 147–151
Laraqui A, Baataoui A, Saaidi A, Jarrar A, Masrar M, Satori K (2016) Image mosaicing using voronoi diagram. Multimed Tools Appl 76(6):8803–8829
Levin A, Zomet A, Peleg S, Weiss Y (2004) Seamless image stitching in the gradient domain. In: European Conference on Computer Vision, pp 377–389
Li J, Wang Z, Lai S, Zhai Y, Zhang M (2018) Parallax-tolerant image stitching based on robust elastic warping. IEEE Trans Multimed 20(7):1672–1687
Lin K, Liu S, Cheong LF, Zeng B (2016) Seamless video stitching from hand-held camera inputs. Comput Graph Forum 35(2):479–487
Liu SB, Wang JH, Yuan RY et al (2020) Real-time and ultrahigh accuracy image synthesis algorithm for full field of view imaging system. Sci Rep 10(1):1–12
Lowe DG (2004) Distinctive image features from scale-invariant key points. Int J Comput Vis 60(2):91–110
Luo X, Li Y, Yan J, Guan X (2020) Image stitching with positional relationship constraints of feature points and lines. Pattern Recognit Lett 135:431–440
Pilchak AL, Shiveley AR, Shade PA, Tiley JS, Ballard DL (2012) Using cross-correlation for automated stitching of two-dimensional multi-tile electron backscatter diffraction data. J Microsc 248(2):172–186
Rivaz H, Karimaghaloo Z, Collins DL (2014) Self-similarity weighted mutual information: a new nonrigid image registration metric. Med Image Anal 18(2):343–358
Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: An efficient alternative to SIFT or SURF. In: IEEE international conference on computer vision, pp 2564–2571
Su H, Wang J, Li Y, Hong X, Li P (2014) An algorithm for stitching images with different contrast and elimination of ghost. 2014 Seventh International Symposium on Computational Intelligence and Design, Hangzhou, pp 104–107
Szeliski R (2006) Image alignment and stitching: A tutorial. Foundations and Trends® in Computer Graphics and Vision 2(1):1-104
Vaidya OS, Gandhe ST (2018) The study of preprocessing and postprocessing techniques of image stitching. In: International Conference On Advances in Communication and Computing Technology, pp 431–435
Vishwakarma A, Bhuyan MK (2020) Image mosaicking using improved auto-sorting algorithm and local difference-based harris features. Multimed Tools Appl 79(1):1–18
Wang D, Liu H, Li K, Zhou W (2017) An image fusion algorithm based on trigonometric functions. Infrared Technol 39(1):53–57
Xianyong F, Zhigeng P (2003) An improved algorithm for image mosaics. J Comput Aided Des Comput Graph 11:1362–1365
Yadav G, Maheshwari S, Agarwal A (2014) Contrast limited adaptive histogram equalization based enhancement for real time video system. In: International Conference On Advances in Communication and Computing Technology, pp 2392–2397
Yi KM, Trulls E, Lepetit V, Fua P (2016) Lift: Learned invariant feature transform. In: European conference on computer vision, pp 467–483
Zaragoza J, Chin T, Tran Q, Brown MS, Suter D (2014) As-projective-as-possible image stitching with moving DLT. IEEE Trans Pattern Anal Mach Intell, pp 1285–1298
Zheng J, Wang Y, Wang H, Li B, Hu HM (2019) A novel projective-consistent plane based image stitching method. IEEE Trans Multimed 21(10):2561–2575
Acknowledgements
This work was supported in part by the National Natural Science Foundation for Young Scientists of China (61,603,319, 61,601,385).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lu, J., Huo, G. & Cheng, J. Research on image stitching method based on fuzzy inference. Multimed Tools Appl 81, 23991–24002 (2022). https://doi.org/10.1007/s11042-022-12748-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12748-9