Abstract
This paper outlines an architecture formulti-camera andmulti-modal sensor fusion.We define a high-level architecture in which image sensors like standard color, thermal, and time of flight cameras can be fused with high accuracy location systems based on UWB, Wifi, Bluetooth or RFID technologies. This architecture is specially well-suited for indoor environments, where such heterogeneous sensors usually coexists. The main advantage of such a system is that a combined nonredundant output is provided for all the detected targets. The fused output includes in its simplest form the location of each target, including additional features depending of the sensors involved in the target detection, e.g., location plus thermal information. This way, a surveillance or context-aware system obtains more accurate and complete information than only using one kind of technology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abowd, G., Mynatt, E.: Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction (TOCHI) 7(1), 58 (2000)
Atallah, L., ElHelw, M., Pansiot, J., Stoyanov, D., Wang, L., Lo, B., Yang, G.: Behaviour profiling with ambient and wearable sensing. In: 4th International Workshop on Wearable and Implantable Body Sensor Networks (BSN 2007), pp. 133–138. Springer, Heidelberg (2007)
Chen, G., Kotz, D.: A survey of context-aware mobile computing research. Technical report, Citeseer (2000)
Germa, T., Lerasle, F., Ouadah, N., Cadenat, V.: Vision and RFID data fusion for tracking people in crowds by a mobile robot. Computer Vision and Image Understanding (2010)
Gezici, S., Tian, Z., Giannakis, G., Kobayashi, H., Molisch, A., Poor, H., Sahinoglu, Z.: Localization via ultra-wideband radios: a look at positioning aspects for future sensor networks. IEEE Signal Processing Magazine 22(4), 70–84 (2005)
Hahnel, D., Burgard, W., Fox, D., Fishkin, K., Philipose, M.: Mapping and localization with RFID technology. In: Proceedings of IEEE International Conference on Robotics and Automation, 2004. ICRA 2004, vol. 1 (2004)
Hall, D., Llinas, J.: An introduction to multisensor data fusion. Proceedings of the IEEE 85(1), 6–23 (1997)
Hall, D., Llinas, J.: Handbook of multisensor data fusion. CRC, Boca Raton (2001)
Harter, A., Hopper, A., Steggles, P., Ward, A., Webster, P.: The anatomy of a context-aware application. Wireless Networks 8(2), 187–197 (2002)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge Univ. Pr., Cambridge (2003)
Hofmann, U., Rieder, A., Dickmanns, E.: Radar and vision data fusion for hybrid adaptive cruise control on highways. Machine Vision and Applications 14(1), 42–49 (2003)
Hongeng, S., Nevatia, R., Bremond, F.: Video-based event recognition: activity representation and probabilistic recognition methods. Computer Vision and Image Understanding 96(2), 129–162 (2004)
Kanade, T., Collins, R., Lipton, A., Burt, P., Wixson, L.: Advances in cooperative multi-sensor video surveillance. In: Proceedings of DARPA Image Understanding Workshop, Citeseer, vol. 1, p. 2 (1998)
Lim, H., Kung, L., Hou, J., Luo, H.: Zero-configuration, robust indoor localization: theory and experimentation. In: Proceedings of IEEE Infocom, Citeseer, pp. 123–125 (2006)
Luis, A., Patricio, M.: Scalable Streaming of JPEG 2000 Live Video Using RTP over UDP. In: International Symposium on Distributed Computing and Artificial Intelligence 2008 (DCAI 2008), pp. 574–581. Springer, Heidelberg (2008)
Maass, H.: Location-aware mobile applications based on directory services. Mobile Networks and Applications 3(2), 157–173 (1998)
Yamato, J., Ohya, J., Ishii, K.: Recognizing human action in time-sequential images using hidden Markov model. In: Proc. Comp. Vis. and Pattern Rec., pp. 379–385 (1992)
Yilmaz, A., Javed, O., Shah, M.: Object tracking: A survey. ACM Computing Surveys (CSUR) 38(4), 13 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bustamante, A.L., Molina, J.M., Patricio, M.A. (2010). Multi-camera and Multi-modal Sensor Fusion, an Architecture Overview. In: de Leon F. de Carvalho, A.P., RodrÃguez-González, S., De Paz Santana, J.F., RodrÃguez, J.M.C. (eds) Distributed Computing and Artificial Intelligence. Advances in Intelligent and Soft Computing, vol 79. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14883-5_39
Download citation
DOI: https://doi.org/10.1007/978-3-642-14883-5_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14882-8
Online ISBN: 978-3-642-14883-5
eBook Packages: EngineeringEngineering (R0)