Skip to main content
SpringerLink
Log in

Image mosaicking using improved auto-sorting algorithm and local difference-based harris features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image mosaicking is an image processing technique which is useful for tiling images. Image Mosaicing stitches many correlated images to get a picture of a greater field of view. General-purpose cameras, which have a low field of view, can not create images with a higher field of view while mosaicking can help us achieve it. One important step in an image mosaicking framework is the auto-sorting algorithm, which is to be performed to minimize registration errors in the mosaic image. Another step in mosaicking is the detection of interest points for matching of the source images obtained after auto-sorting. However, in the presence of noisy and pseudo-periodic structures in the source images, the existing auto-sorting methods generally produce distortions in the final mosaic image. Secondly, most of the popular interest point detection algorithms do not specifically consider computational issues. So, this work mainly addresses the above-mentioned problems which are generally encountered during image mosaicking. The problem of image auto-sorting can be partially solved by adopting a phase correlation strategy. In our method, the sorting procedure is further improved by deploying the structural similarity index (SSIM) measure instead of using the phase correlation. The issue of high time complexity of conventional corner detectors is reduced by using our proposed local difference operation in place of standard Sobel edge detector. Experimental results show the efficacy of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Bay H, Tuytelaars T, Van Gool L (2006) Surf: Speeded up robust features. In: Leonardis A, Bischof H, Pinz A (eds) Computer vision – ECCV 2006. Springer, Berlin, pp 404–417

  2. Dai H, Hu B, Cui Q, Zou Z (2017) Videogis data retrieval based on multi-feature fusion. In: 2017 12Th international conference on intelligent systems and knowledge engineering (ISKE), pp 1–9. https://doi.org/10.1109/ISKE.2017.8258831

  3. Dawn S, Khera A, Agarwal N, Arora A (2018) Panorama generation from a video. In: 2018 5Th IEEE uttar pradesh section international conference on electrical, electronics and computer engineering (UPCON), pp 1–4. https://doi.org/10.1109/UPCON.2018.8597171

  4. Fu Z, Wang L (2014) Optimized design of automatic image mosaic. Multimed Tools Appl 72(1):503–514

    Article  Google Scholar 

  5. Galdran A, Vazquez-Corral J, Pardo D, Bertalmío M (2017) Fusion-based variational image dehazing. IEEE Signal Process Lett 24(2):151–155

    MATH  Google Scholar 

  6. Gao G, Jia K (2007) A new image mosaics algorithm based on feature points matching. In: Second international conference on innovative computing, informatio and control (ICICIC 2007), pp 471–471

  7. Ghosh D, Kaabouch N (2016) A survey on image mosaicing techniques. J Vis Commun Image Represent 34:1–11

    Article  Google Scholar 

  8. Gracias N, Mahoor M, Negahdaripour S, Gleason A (2009) Fast image blending using watersheds and graph cuts. Image Vis Comput 27(5):597–607

    Article  Google Scholar 

  9. Harris C, Stephens M (1988) A combined corner and edge detector. In: proceedings of fourth alvey vision conference, pp 147–151

  10. http://www.mr-tip.com/serv1.php (access on 26/10/2018)

  11. https://homepages.cae.wisc.edu/~ece533/images/ (access on 26/10/2018)

  12. https://sites.google.com/a/umich.edu/eecs442-winter2015/homework/image-stitching?tmpl=1 (access on 26/10/2018)

  13. https://in.mathworks.com/matlabcentral/fileexchange/46148-image-mosaicing (access on 26/10/2018)

  14. https://github.com/daeyun/Image-Stitching/tree/master/img (access on 26/10/2018)

  15. Huang KY, Cheng JF (2017) A novel auto-sorting system for chinese cabbage seeds. Sensors 17(4). https://doi.org/10.3390/s17040886

  16. Ju MY, Ding C, Zhang DY, Guo YJ (2018) Gamma-correction-based visibility restoration for single hazy images. IEEE Signal Processing Letters:1–1

  17. Lama R, Han SJ, Kwon GR (2014) Svd based improved secret fragment visible mosaic image generation for information hiding. Multimed Tools Appl 73(2):873–886

    Article  Google Scholar 

  18. Laraqui A, Baataoui A, Saaidi A, Jarrar A, Masrar M, Satori K (2017) Image mosaicing using voronoi diagram. Multimed Tools Appl 76(6):8803–8829

    Article  Google Scholar 

  19. Leutenegger S, Chli M, Siegwart RY (2011) Brisk: Binary robust invariant scalable keypoints. In: Proceedings of the 2011 International Conference on Computer Vision, ICCV ’11. Computer Society, Washington, pp 2548–2555

  20. Li C, Guo J, Guo C (2018) Emerging from water: Underwater image color correction based on weakly supervised color transfer. IEEE Signal Process Lett 25 (3):323–327

    Article  Google Scholar 

  21. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  22. Okumura IK, Raut S, Gu Q, Aoyama T, Takaki T, Ishii I (2013) Real-time feature-based video mosaicing at 500 fps. In: 2013 IEEE/RSJ International conference on intelligent robots and systems, pp 2665–2670

  23. Pandey A, Pati UC (2013) A novel technique for non-overlapping image mosaicing based on pyramid method. In: 2013 Annual IEEE India conference (INDICON), pp 1–6

  24. Patil VP, Gohatre UB (2017) Techniques of developing panorama for low light images. In: 2017 International conference on energy, communication, data analytics and soft computing (ICECDS), pp 2547–2552. https://doi.org/10.1109/ICECDS.2017.8389913

  25. Plant W, Lumsden J, Nabney I (2013) The mosaic test: Measuring the effectiveness of colour-based image retrieval. Multimed Tools Appl 64(3):695–716

    Article  Google Scholar 

  26. Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: Leonardis A, Bischof H, Pinz A (eds) Computer vision – ECCV 2006. Springer, Berlin, pp 430–443

  27. Schaffalitzky F, Zisserman A (2002) Multi-view matching for unordered image sets, or “how do i organize my holiday snaps?”. In: Heyden A, Sparr G, Nielsen M, Johansen P (eds) Computer vision — ECCV 2002. Springer, Berlin, pp 414–431

  28. Shao W, Na L, Lijuan S, Shulin S, Xiangpeng L (2012) Two improved methods of sift algorithm combined with harris. In: 2012 24Th chinese control and decision conference (CCDC), pp 3251–3254

  29. Sharma N, Pal U, Blumenstein M (2012) Recent advances in video based document processing: a review. In: 2012 10Th IAPR international workshop on document analysis systems, pp 63–68. https://doi.org/10.1109/DAS.2012.72

  30. Shi B, Bai S, Zhou Z, Bai X (2015) Deeppano: Deep panoramic representation for 3-d shape recognition. IEEE Signal Process Lett 22(12):2339–2343

    Article  Google Scholar 

  31. Song R, Szymanski J (2008) Auto-sorting scheme for image ordering applications in image mosaicing. Electron Lett 44(13):798–799

    Article  Google Scholar 

  32. Szeliski R (2004) Image alignment and stitching: A tutorial. Technical report

  33. Vishwakarma A, Bhuyan MK, Iwahori Y (2018) Non-subsampled shearlet transform-based image fusion using modified weighted saliency and local difference. Multimed Tools Appl 77(24):32,013–32,040

    Article  Google Scholar 

  34. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13 (4):600–612

    Article  Google Scholar 

  35. Wang Z, Chen Y, Zhu Z, Zhao W (2016) An automatic panoramic image mosaic method based on graph model. Multimed Tools Appl 75(5):2725–2740

    Article  Google Scholar 

  36. Wang H, Sandin DJ, Schonfeld D (2017) A common feature-based disparity control strategy in stereoscopic panorama generation. In: 2017 IEEE Visual communications and image processing (VCIP), pp 1–4. https://doi.org/10.1109/VCIP.2017.8305051

  37. Wu Y, Li J (2002) Concentric mosaic compression with rebinning of slits (ross). IEEE Signal Process Lett 9(9):269–271

    Article  Google Scholar 

  38. Xiong Y, Turkowski K (1998) Registration, calibration and blending in creating high quality panoramas. In: Applications of computer vision, 1998. WACV ’98. Proceedings., fourth IEEE workshop on, pp 69–74

  39. Yao W, Li Z (2015) Instant color matching for mobile panorama imaging. IEEE Signal Process Lett 22(1):6–10

    Article  Google Scholar 

  40. Ye J, Chen H, Tsai W (2018) Panorama generation based on aerial images. In: 2018 IEEE International conference on multimedia expo workshops (ICMEW), pp 1–6. https://doi.org/10.1109/ICMEW.2018.8551548https://doi.org/10.1109/ICMEW.2018.8551548

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati, Guwahati, 781039, India

    Amit Vishwakarma & M. K. Bhuyan

Authors
  1. Amit Vishwakarma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. K. Bhuyan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. K. Bhuyan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vishwakarma, A., Bhuyan, M.K. Image mosaicking using improved auto-sorting algorithm and local difference-based harris features. Multimed Tools Appl 79, 23599–23616 (2020). https://doi.org/10.1007/s11042-020-09124-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09124-w

Keywords

Search

Navigation