Summary
The paper presents complete real-time image fusion system intended for supervisory and monitoring purposes in mobile appliances. The system is equipped with an optoelectronic head containing two multiband image sensors: TV and IR (infrared). System structure as well as searching process of the efficient, real-time image processing algorithms are briefly described. Principally, image registration is based on the hybrid approach (edge extraction and phase correlation). The image fusion method can be chosen according to operator demands between Laplacian pyramid and FABEMD decomposition. Real-time multispectral video signals processing is performed by application of custom hardware solution based on a single FPGA chip. This allows for implementing fast paralleled and pipelined processing flow. The system hardware is also presented in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Putz, B., Timofiejczuk, A., Bartys, M., Gwardecki, J.: System of TV and thermal image fusion for real-time application monitoring. Pomiary Automatyka Kontrola 57(7), 784–788 (2011)
Zitová, B., Flusser, J.: Image registration methods: a survey. Image and Vision Computing 21(11), 977–1000 (2003)
Wyawahare, M.V., Pradeep, M.P., Abhyankar, H.K.: Image Registration Techniques: An overview. International Journal of Signal Processing, Image Processing and Pattern Recognition 2(3), 11–27 (2009)
Klimaszewski, J., Kondej, M., Kawecki, M., Putz, B.: Registration of Infrared and Visible Images Based on Edge Extraction and Phase Correlation Approaches. In: Choraś, R.S. (ed.) Image Processing & Communications Challenges 4. AISC, vol. 184, pp. 157–166. Springer, Heidelberg (2012)
Dwyer, D., Smith, M., Dale, J., Heather, J.: Real time implementation of image alignment and fusion. In: Driggers, R.G., Huckridge, D.A. (eds.) Proc. SPIE Electro-Optical and Infrared Systems: Technology and Applications, vol. 5612, pp. 85–93 (2004)
Ahmed, M.U., Mandic, D.P.: fusion based on Fast and Adaptive Bidimensional Empirical Mode Decomposition. In: Proc. IEEE 13th Int. Conf. on Information Fusion, pp. 1–6 (2010)
Wielgus, M., Antoniewicz, A., Bartys, M., Putz, B.: Fast and Adaptive Bidimensional Empirical Mode Decomposition for the Real-time Video Fusion. Accepted at IEEE 15th Int. Conf. on Information Fusion, pp. 1–6 (2012)
Lewis, J.J., et al.: The Eden Project multi-sensor data set. Technical report TR-UoB-WS-Eden-Project-Data-Set. University of Bristol and Waterfall Solutions Ltd., UK (2006)
Liang, W., Liu, Z.: Region-based Fusion of Infrared and Visible Images Using Bidimensional Empirical Mode Decomposition. In: Int. Conf. on Educ. and Inf. Techn., ICEIT, pp. V3-358–V3-363 (2010)
Qu, G., Zhang, D., Yan, P.: Information measure for performance of image fusion. Electronics Letters 38, 313–315 (2002)
Xydeas, C., Petrovic, V.: Objective image fusion performance measure. Electronics Letters 36, 308–309 (2000)
Wielgus, M., Putz, B.: Comparative Analysis of Image Fusion Performance Evaluation Methods for the Real-time Environment Monitoring System. In: Choraś, R.S. (ed.) Image Processing & Communications Challenges 4. AISC, vol. 184, pp. 123–130. Springer, Heidelberg (2012)
Antoniewicz, A.: FPGA Implementation of Decomposition Methods for Real-time Image Fusion. In: Choraś, R.S. (ed.) Image Processing & Communications Challenges 4. AISC, vol. 184, pp. 167–174. Springer, Heidelberg (2012)
IEEE 1014-1987, VME Specification
ANSI/VITA 1-1994; VME64 Specification
Bartys, M., Zbrzezny, L., Antoniewicz, A., Putz, B.: Real-time Single FPGA-Based Multimodal Image Fusion System. Accepted at 2012 IEEE International Conference on Imaging Systems and Techniques, IST 2012 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Putz, B., Bartyś, M., Antoniewicz, A., Klimaszewski, J., Kondej, M., Wielgus, M. (2013). Real-Time Image Fusion Monitoring System: Problems and Solutions. In: Choraś, R. (eds) Image Processing and Communications Challenges 4. Advances in Intelligent Systems and Computing, vol 184. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32384-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-32384-3_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32383-6
Online ISBN: 978-3-642-32384-3
eBook Packages: EngineeringEngineering (R0)