Abstract
In the recent years multimodal interfaces have acquired an important role in human computer interaction applications. Subsequently these interfaces become more and more human-oriented. Humans use multimodality to reduce ambiguity and incompleteness of information. Seemingly they are able to switch easily from one modality to the other and fuse the information from different multimodal sources. The goal of our research was to develop a crisis based human like multimodal system. In particular, we bring into focus the multimodal interaction between human users and the automatic crisis system and its correlation with the adaptability to the human behavior in crisis situations. Our system is capable of conceding for an optimal interaction process by taking into account the major informational human channels while gathering the user inputs and producing the system feedback. In this paper we describe the design of our system which is implemented as a running prototype. We have conducted a simulation of a crisis event to measure the degree of user satisfaction. At last we discuss the drawbacks as well as the premises of our solution in the context of the high level of performance achieved by our approach.
Chapter PDF
Similar content being viewed by others
Keywords
References
Corson, S., Macker, J.: RFC2501: Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations (1999)
Datcu, D., Zhenke, Y., Rothkrantz, L.J.M.: Multimodal workbench for automatic surveillance applications. In: Multimodal Surveillance: Sensors, Algorithms and Systems Chapter 14 (2007)
Delhay, S., Idrissa, M., Lacroix, V.: PARADIS: GIS Tools for Humanitarian Demining. In: The 2nd International ISCRAM Conference, pp. 213–219 (2005)
Fitrianie, S., Datcu, D., Rothkrantz, L.J.M.: Constructing Knowledge of the World in Crisis Situations using Visual Language. In: IEEE International Conference on Systems, Man, and Cybernetics (2006)
Fuhrmann, S., MacEachren, A.M., Dou, J., Wang, K., Cox, A.: Gesture and Speech-Based Maps to Support Use of GIS for Crisis Management: A User Study. AutoCarto (2005)
Granica, K., Nagler, T., Eisl, M.M., Schardt, M., Rott, H.: Satellite Remote Sensing Data for an Alpine Related Disaster Management GIS. In: The 2nd International ISCRAM Conference, pp. 221–232 (2005)
Rothkrantz, L.J.M., Datcu, D., Fitrianie, S., Tatomir, B.: Personal Mobile Support for Crisis Management Using Ad-Hoc Networks. In: The 11th International Conference on Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah (2005)
Tatomir, B., Rothkrantz, L.J.M.: Crisis Management using Mobile ad-hoc Wireless Networks. In: The 2nd International ISCRAM Conference, pp. 147–149 (2005)
Gaynor, M., Seltzer, M., Moulton, S., Freedman, J.: A Dynamic, Data-Driven, Decision Support System for Emergency Medical Services. In: ICCS 2005, pp. 703–711. Springer, Heidelberg (2005)
Goh, O.S., Ardil, C., Fung, C.C., Wong, K.W., Depickere, A.: A Crisis Communication Network Based on Embodied Conversational Agents System with Mobile Services. International Journal of Information Technology 3(4) (2006) ISSN 1305-2403
Jakobson, G.N., Parameswaran, J., Burford, L., Lewis, P.: Ray: Situation-aware Multi-Agent System for Disaster Relief Operations Management. In: Proc. ISCRAM, pp. 313–324 (2006)
Sharma, R., Yeasin, M., Krahnstoever, N., Rauschert, I., Cai, G., Brewer, I., MacEachren, A.M., Sengupta, K.: Speech–Gesture Driven Multimodal Interfaces for Crisis Management. Proceedings of the IEEE 91(9), 1327–1354 (2003)
Thalmann, D., Salamin, P., Ott, R., Gutierrez, M., Vexo, F.: Advanced Mixed Reality Technologies for Surveillance and Risk Prevention Applications. In: Levi, A., Savaş, E., Yenigün, H., Balcısoy, S., Saygın, Y. (eds.) ISCIS 2006. LNCS, vol. 4263, pp. 13–23. Springer, Heidelberg (2006)
van Veelen, J.B., Storms, P., van Aart, C.J.: Effective and Efficient Coordination Strategies for Agile Crisis Response Organizations. In: Proc. ISCRAM 2006, pp. 202–213 (2006)
Weigand, H.: Agent Community Support for Crisis-ResponseOrganizations. In: Meersman, R., Tari, Z., Herrero, P. (eds.) On the Move to Meaningful Internet Systems 2006: OTM 2006 Workshops. LNCS, vol. 4277, pp. 218–226. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Datcu, D., Yang, Z., Rothkrantz, L. (2007). A System for Adaptive Multimodal Interaction in Crisis Environments. In: Aykin, N. (eds) Usability and Internationalization. Global and Local User Interfaces. UI-HCII 2007. Lecture Notes in Computer Science, vol 4560. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73289-1_39
Download citation
DOI: https://doi.org/10.1007/978-3-540-73289-1_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73288-4
Online ISBN: 978-3-540-73289-1
eBook Packages: Computer ScienceComputer Science (R0)