Zhengcong Yin
ABSTRACT
A spatio-temporal analysis system is becoming critical in many disciplinaries to acquire, analyze, and visualize data. However, conducting spatio-temporal analysis often requires certain levels of domain knowledge and experience: on one hand, sophisticated and domain-specific software design makes the analysis difficult for public users; on the other hand, conveying findings from the analysis could result in ineffectiveness and inefficiencies. In this work, we present a Natural Language Processing (NLP)-enabled Question Answering (QA) framework for spatio-temporal analysis and visualization. It allows users to conduct spatio-temporal analysis by speaking or typing questions. Interactive visualization component in the framework creates better communication between insights and users. We use a dataset from the domain of climate science as a case study to demonstrate the framework. The case study is evaluated through a mid-size software company, and great feedback was received. With the microservice architecture in it, the framework is general enough to be applied in a variety of applications and domains.
- Jeff Dunn. 2016. We put siri, alexa, google assistant, and cortana through a marathon of tests to see who's winning the virtual assistant race-here's what we found. Business Insider, November 4 (2016).Google Scholar
- S. Gao and M. F. Goodchild. 2013. Asking Spatial Questions to Identify GIS Functionality. In 2013 Fourth International Conference on Computing for Geospatial Research and Application. 106--110. Google ScholarDigital Library
- Deepak Gupta, Pabitra Lenka, Asif Ekbal, and Pushpak Bhattacharyya. 2018. Uncovering Code-Mixed Challenges: A Framework for Linguistically Driven Question Generation and Neural based Question Answering. In Proceedings of the 22nd Conference on Computational Natural Language Learning. 119--130.Google ScholarCross Ref
- Bo Huang, Bin Jiang, and Hui Li. 2001. An integration of GIS, virtual reality and the Internet for visualization, analysis and exploration of spatial data. International Journal of Geographical Information Science 15, 5 (2001), 439--456.Google ScholarCross Ref
- Gengchen Mai, Krzysztof Janowicz, Cheng He, Sumang Liu, and Ni Lao. 2018. POIReviewQA: A Semantically Enriched POI Retrieval and Question Answering Dataset. arXiv preprint arXiv:1810.02802. Google ScholarDigital Library
- Luboš Matejíček, Pavel Engst, and Zbyněk Jaňour. 2006. A GIS-based approach to spatio-temporal analysis of environmental pollution in urban areas: A case study of Prague's environment extended by LIDAR data. Ecological Modelling 199, 3 (2006), 261--277.Google ScholarCross Ref
- Sam Newman. 2015. Building microservices: designing fine-grained systems. " O'Reilly Media, Inc.". Google ScholarDigital Library
- Fredrik Olsson. 2009. A literature survey of active machine learning in the context of natural language processing. (2009).Google Scholar
- Ingmar Rauschert, Pyush Agrawal, Rajeev Sharma, Sven Fuhrmann, Isaac Brewer, and Alan MacEachren. 2002. Designing a Human-centered, Multimodal GIS Interface to Support Emergency Management. In Proceedings of the 10th ACM International Symposium on Advances in Geographic Information Systems (GIS'02). ACM, New York, NY, USA, 119--124. Google ScholarDigital Library
- Günther Sagl, Bernd Resch, Bartosz Hawelka, and Euro Beinat. 2012. From social sensor data to collective human behaviour patterns: Analysing and visualising spatio-temporal dynamics in urban environments. In Proceedings of the GI-Forum. Herbert Wichmann Verlag Berlin, 54--63.Google Scholar
- Leandro L Tavares, Renato M Silva, and Tiago A Almeida. 2018. Towards Automatically Creating Large Labeled Datasets for Training Question Domain Classifiers. In 2018 International Joint Conference on Neural Networks (IJCNN). IEEE, 1--8.Google Scholar
- Miguel Torres, Rolando Quintero, Marco Moreno, and Frederico Fonseca. 2005. Ontology-driven description of spatial data for their semantic processing. In International Conference on GeoSpatial Sematics. Springer, 242--249. Google ScholarDigital Library
- Jue Wang and Mei-Po Kwan. 2018. An Analytical Framework for Integrating the Spatiotemporal Dynamics of Environmental Context and Individual Mobility in Exposure Assessment: A Study on the Relationship between Food Environment Exposures and Body Weight. International journal of environmental research and public health 15, 9 (2018), 2022.Google ScholarCross Ref
Index Terms
- An NLP-based Question Answering Framework for Spatio-Temporal Analysis and Visualization
Recommendations
A Model and Framework for Visualization Exploration
Visualization exploration is the process of extracting insight from data via interaction with visual depictions of that data. Visualization exploration is more than presentation; the interaction with both the data and its depiction is as important as ...
Exploring Chart Question Answering for Blind and Low Vision Users
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsData visualizations can be complex or involve numerous data points, making them impractical to navigate using screen readers alone. Question answering (QA) systems have the potential to support visualization interpretation and exploration without ...
A Distributed Framework for Spatio-Temporal Analysis on Large-Scale Camera Networks
ICDCSW '13: Proceedings of the 2013 IEEE 33rd International Conference on Distributed Computing Systems WorkshopsCameras are becoming ubiquitous. Applications including video-based surveillance and emergency response exploit camera networks to detect anomalies in real time and reduce collateral damage. A well-known technique for detecting anomalies is spatio-...
Comments