Skip to main content

Accelerating Image Fusion Algorithms Using CUDA on Embedded Industrial Platforms Dedicated to UAV and UGV

  • Conference paper
  • First Online:
  • 958 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 920))

Abstract

The objective of image fusion is to combine information from multiple images of the same scene, where the image result of fusion is more suitable for human and machine perception. This process is usually time consuming on most standard computing platforms that can be used in autonomous and semi-autonomous platforms, such as an unmanned ground vehicle (UGV) and an unmanned aerial vehicle (UAV). This creates a conflict between satisfying the hardware requirements and the platform’s current demand. In this article, we propose a solution to this problem, being an image fusion algorithm utilizing CUDA technology, dedicated for an embedded platform (~5 W), allowing for image processing in 25 fps, which should be satisfactory for the needs of the mentioned platforms. During the development, we researched multimodal image fusion algorithms and implemented the chosen methods. The chosen testing environment and chosen measures of the quality of the fusion are presented as well.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Goshtasby, A., Nikolov, S.: Image fusion: advances in the state of the art. Inf. Fusion 8(2), 114–118 (2007). Special Issue on Image Fusion: Advances in the State of the Art

    Article  Google Scholar 

  2. Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)

    Article  Google Scholar 

  3. Arthur, J.J., Kramer, L.J., Bailey, R.E.: Flight test comparison between enhanced vision (FLIR) and synthetic vision systems, SPIE-INT SOC Optical Engineering, BELLINGHAM, 25–36 (2005)

    Google Scholar 

  4. Products citadel. http://www.copst.com/productscitadel. Accessed 28 Oct 2018

  5. Citadel thermal. http://www.copst.com/citadel-thermal. Accessed 28 Oct 2018

  6. Orlaco famos camera. https://www.orlaco.com/product/orlaco-famos-camera. Accessed 28 Oct 2018

  7. Jetson. https://elinux.org/Jetson_TK1. Accessed 28 Oct 2018

  8. Choi, M.: A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter. IEEE Trans. Geosci. Remote Sens. 44(6), 1672–1682 (2006). Print ISSN 0196-2892

    Article  Google Scholar 

  9. Burt, P.J., Adelson, E.H.: The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 4(31), 532–540 (1983)

    Article  Google Scholar 

  10. TNO Image Fusion Dataset. https://figshare.com/articles/TNO_Image_Fusion_Dataset/1008029. Accessed 28 Oct 2018

  11. Maruthi, R., Suresh, R.M.: Metrics for measuring the quality of fused images. In: International Conference on Computational Intelligence and Multimedia Applications (2007)

    Google Scholar 

  12. Xydeas, C., Petrovic, V.: Objective image fusion performance measure. Electron. Lett. 36, 308–309 (2000)

    Article  Google Scholar 

  13. Osińska-Skotak, K.: Ocena przydatności różnych metod integracji obrazów panchromatycznych i wielospektralnych w odniesieniu o zobrazowań Worldview-2. Arch. Fotogram. Kartogr. Teledetekcji 24, 231–244 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Artur Kaczmarczyk or Weronika Zatorska .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaczmarczyk, A., Zatorska, W. (2020). Accelerating Image Fusion Algorithms Using CUDA on Embedded Industrial Platforms Dedicated to UAV and UGV. In: Szewczyk, R., Zieliński, C., Kaliczyńska, M. (eds) Automation 2019. AUTOMATION 2019. Advances in Intelligent Systems and Computing, vol 920. Springer, Cham. https://doi.org/10.1007/978-3-030-13273-6_65

Download citation

Publish with us

Policies and ethics