Skip to main content
Log in

Research on image stitching method based on fuzzy inference

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper concern the problem of ghosting caused by parallax and moving objects in image stitching. Previous approaches have used local homography or optimal seam lines to avoid ghosting. In this work, we propose an image stitching method based on fuzzy inference. At first, our use of the contrast limited adaptive histogram equalization (CLAHE) increase the matching points of the object surface in the low-contrast images. Then, to reduce the number of mismatching points, we combine the orientation of feature points to improve the zero-mean normalized cross-correlation (ZNCC) for filter matching points. Furthermore, by viewing the distance weight and gray difference of pixels in overlapping region as the first input and the second input of fuzzy inference respectively, and regarding the output of the fuzzy inference as the weight of image fusion. We generate high-quality stitching images. The experimental results show that our approach can reduce the ghosting phenomenon and improve the quality of the stitching.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Adwan S, Alsaleh I, Majed R (2016) A new approach for image stitching technique using Dynamic Time Warping (DTW) algorithm towards scoliosis X-ray diagnosis. Measurement 84:32–46

  2. Bay H, Tuytelaars T, Van Gool L (2006) Surf: Speeded up robust features. In: Proceedings 9th European conference computer vision, pp 404–417

  3. Brown M, Lowe DG (2007) Automatic panoramic image stitching using invariant features. Int J Comput Vis 74(1):59–73

  4. Chang CH, Sato Y, Chuang YY (2014) Shape-preserving half-projective warps for image stitching. In: Proceedings IEEE Conference on Computer Vision Pattern Recognition, pp 3254–3261

  5. Dame A, Marchand E (2012) Second-order optimization of mutual information for real-time image registration. IEEE Trans Image Process 21(9):4190–4203

  6. Davis J (1998) Mosaics of scenes with moving objects. In: Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 354–360

  7. Duplaquet ML (1998) Building large image mosaics with invisible seam lines. In: Proceedings Visual Information Processing VII, pp 369–377

  8. Fang F, Wang T, Fang Y, Zhang G (2019) Fast color blending for seamless image stitching. IEEE Geosci Remote Sens Lett 16(7):1115–1119

  9. Gao J, Kim SJ, Brown MS (2011) Constructing image panoramas using dual-homography warping. In: Proceedings of the 2011 IEEE conference on computer vision and pattern recognition, pp 49–56

  10. Harris CG, Stephens M (1988) A combined corner and edge detector. In: Alvey vision conference, pp 147–151

  11. Laraqui A, Baataoui A, Saaidi A, Jarrar A, Masrar M, Satori K (2016) Image mosaicing using voronoi diagram. Multimed Tools Appl 76(6):8803–8829

  12. Levin A, Zomet A, Peleg S, Weiss Y (2004) Seamless image stitching in the gradient domain. In: European Conference on Computer Vision, pp 377–389

  13. Li J, Wang Z, Lai S, Zhai Y, Zhang M (2018) Parallax-tolerant image stitching based on robust elastic warping. IEEE Trans Multimed 20(7):1672–1687

    Article  Google Scholar 

  14. Lin K, Liu S, Cheong LF, Zeng B (2016) Seamless video stitching from hand-held camera inputs. Comput Graph Forum 35(2):479–487

    Article  Google Scholar 

  15. Liu SB, Wang JH, Yuan RY et al (2020) Real-time and ultrahigh accuracy image synthesis algorithm for full field of view imaging system. Sci Rep 10(1):1–12

  16. Lowe DG (2004) Distinctive image features from scale-invariant key points. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  17. Luo X, Li Y, Yan J, Guan X (2020) Image stitching with positional relationship constraints of feature points and lines. Pattern Recognit Lett 135:431–440

    Article  Google Scholar 

  18. Pilchak AL, Shiveley AR, Shade PA, Tiley JS, Ballard DL (2012) Using cross-correlation for automated stitching of two-dimensional multi-tile electron backscatter diffraction data. J Microsc 248(2):172–186

  19. Rivaz H, Karimaghaloo Z, Collins DL (2014) Self-similarity weighted mutual information: a new nonrigid image registration metric. Med Image Anal 18(2):343–358

  20. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: An efficient alternative to SIFT or SURF. In: IEEE international conference on computer vision, pp 2564–2571

  21. Su H, Wang J, Li Y, Hong X, Li P (2014) An algorithm for stitching images with different contrast and elimination of ghost. 2014 Seventh International Symposium on Computational Intelligence and Design, Hangzhou, pp 104–107

  22. Szeliski R (2006) Image alignment and stitching: A tutorial. Foundations and Trends® in Computer Graphics and Vision 2(1):1-104

  23. Vaidya OS, Gandhe ST (2018) The study of preprocessing and postprocessing techniques of image stitching. In: International Conference On Advances in Communication and Computing Technology, pp 431–435

  24. Vishwakarma A, Bhuyan MK (2020) Image mosaicking using improved auto-sorting algorithm and local difference-based harris features. Multimed Tools Appl 79(1):1–18

  25. Wang D, Liu H, Li K, Zhou W (2017) An image fusion algorithm based on trigonometric functions. Infrared Technol 39(1):53–57

    Google Scholar 

  26. Xianyong F, Zhigeng P (2003) An improved algorithm for image mosaics. J Comput Aided Des Comput Graph 11:1362–1365

    Google Scholar 

  27. Yadav G, Maheshwari S, Agarwal A (2014) Contrast limited adaptive histogram equalization based enhancement for real time video system. In: International Conference On Advances in Communication and Computing Technology, pp 2392–2397

  28. Yi KM, Trulls E, Lepetit V, Fua P (2016) Lift: Learned invariant feature transform. In: European conference on computer vision, pp 467–483

  29. Zaragoza J, Chin T, Tran Q, Brown MS, Suter D (2014) As-projective-as-possible image stitching with moving DLT. IEEE Trans Pattern Anal Mach Intell, pp 1285–1298

  30. Zheng J, Wang Y, Wang H, Li B, Hu HM (2019) A novel projective-consistent plane based image stitching method. IEEE Trans Multimed 21(10):2561–2575

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation for Young Scientists of China (61,603,319, 61,601,385).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jinbo Lu.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, J., Huo, G. & Cheng, J. Research on image stitching method based on fuzzy inference. Multimed Tools Appl 81, 23991–24002 (2022). https://doi.org/10.1007/s11042-022-12748-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12748-9

Keywords

Navigation