Pyush Agrawal
ABSTRACT
A novel interface system for accessing geospatial data (GeoMIP) has been developed that realizes a user-centered multimodal speech/gesture interface for addressing some of the critical needs in crisis management. In this system we primarily developed vision sensing algorithms, speech integration, multimodality fusion, and rule-based mapping of multimodal user input to GIS database queries. A demo system of this interface has been developed for the Port Authority NJ/NY and is explained here.
- MacEachren, A.M., Cai, G., Sharma, R., Rauschert, I., Brewer, I., Bolelli, L., Shaparenko, B., Fuhrmann, S. and Wang, H. Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface. International Journal of Geographical Information Science, in press.Google Scholar
- Rauschert, I., Agrawal, P., Fuhrmann, S., Brewer, I., Wang, H., Sharma, R., Cai, G. and MacEachren, A.M., Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. in 10th ACM International Symposium on Advances in Geographic Information Systems, (McLean, VA, USA, 2002). Google ScholarDigital Library
- Sharma, R., Poddar, I. and Kettebekov, S., Recognition of natural gestures for multimodal interactive map (iMAP). in Advanced Display Federated Laboratory Symposium, (Adelphi, MD, 2000), 77--81.Google Scholar
Index Terms
- Multimodal interface platform for geographical information systems (GeoMIP) in crisis management
Recommendations
GeoCollaborative crisis management: designing technologies to meet real-world needs
dg.o '06: Proceedings of the 2006 international conference on Digital government researchPreventing, preparing for, responding to, and recovering from natural and human-induced disasters all require access to geographically referenced information and tools for making available information relevant to the tasks at hand. Goals of the research ...
Designing a human-centered, multimodal GIS interface to support emergency management
GIS '02: Proceedings of the 10th ACM international symposium on Advances in geographic information systemsGeospatial information is critical to effective, collaborative decision-making during emergency management situations; however conventional GIS are not suited for multi-user access and high-level abstract queries. Currently, decision makers do not ...
Exploring Intent-driven Multimodal Interface for Geographical Information System
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal InteractionGeographic Information Systems (GIS) offers a large amount of functions for performing spatial analysis and geospatial information retrieval. However, off-the-shelf GIS remains difficult to use for occasional GIS experts. The major problem lies in that ...
Comments