Kristina Wolf
ABSTRACT
The effective reporting of climate hazards, such as flash floods, hurricanes, and earthquakes, is critical. To quickly and correctly assess the situation and deploy resou rces, emergency services often rely on citizen reports that must be timely, comprehensive, and accurate. The pervasive availability and use of smartphone cameras allow the transmission of dynamic incident information from citizens in near-real-time. While high-quality reporting is beneficial, generating such reports can place an additional burden on citizens who are already suffering from the stress of a climate-related disaster. Furthermore, reporting methods are often challenging to use, due to their length and complexity. In this paper, we explore reducing the friction of climate hazard reporting by automating parts of the form-filling process. By building on existing computer vision and natural language models, we demonstrate the automated generation of a full-form hazard impact assessment report from a single photograph. Our proposed data pipeline can be integrated with existing systems and used with geospatial data solutions, such as flood hazard maps.
- Helen Sydney Adams. 2022. How Tech-Enhanced Call Handling Can Help Ambulance Services. Retrieved March 7, 2023 from https://healthcare-digital.com/technology-and-ai/how-tech-enhanced-call-handling-can-help-ambulance-servicesGoogle Scholar
- Daniel J Bachmann, Nathan K Jamison, Andrew Martin, Jose Delgado, and Nicholas E Kman. 2015. Emergency Preparedness and Disaster Response: There's an App for That. Prehospital and Disaster Medicine 30, 5 (2015), 486--490.Google ScholarCross Ref
- Dataminr. 2023. First Alert. Retrieved March 7, 2023 from https://www.dataminr.com/first-alertGoogle Scholar
- Ericsson. 2022. Ericsson Mobility Report. Number of Smartphone Subscriptions Worldwide from 2016 to 2021, with Forecasts from 2022 to 2027. Retrieved March 17, 2023 from https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/Google Scholar
- Federal Emergency Management Agency (FEMA). 2023. National Flood Hazard Layer. Retrieved March 27, 2023 from https://hazards-fema.maps.arcgis.com/apps/webappviewer/index.html?id=8b0adb51996444d4879338b5529aa9cdGoogle Scholar
- Behzad Golparvar and Ruo-Qian Wang. 2020. -Supported Citizen Science to Monitor High-Tide Flooding in Newport Beach, California. In Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities. 66--69.Google ScholarDigital Library
- Karina Gomez, Leonardo Goratti, Tinku Rasheed, and Laurent Reynaud. 2014. Enabling Disaster-resilient 4G Mobile Communication Networks. IEEE Communications Magazine 52, 12 (2014), 66--73.Google ScholarCross Ref
- Amy/ WUSF Public Media Green. 2022. Florida Commits $1 Billion to Climate Resilience. after Hurricane Ian, Some Question the State's Development Practices. Retrieved March 27, 2023 from https://wusfnews.wusf.usf.edu/environment/2022-10-13/florida-commits-1-billion-climate-resilience-hurricane-ian-some-question-state-development-practicesGoogle Scholar
- Hexagon. 2023. Detect Complex Emergencies Sooner with the Help of Assistive AI. Retrieved March 7, 2023 from https://hexagon.com/products/hxgn-oncall-dispatch-smart-advisorGoogle Scholar
- JESIP. 2023. Introduction to the Joint Doctrine. Retrieved March 27, 2023 from https://www.jesip.org.uk/joint-doctrine/introduction-to-the-joint-doctrine/Google Scholar
- JESIP. 2023. M/ETHANE. Retrieved March 17, 2023 from https://www.jesip.org.uk/joint-doctrine/m-ethane/Google Scholar
- Lilong Jiang, Protiva Rahman, and Arnab Nandi. 2018. Evaluating Interactive Data Systems: Workloads, Metrics, and Guidelines. In Proceedings of the 2018 International Conference on Management of Data. ACM, 1637--1644.Google ScholarDigital Library
- HPCi Media. 2022. Struggling Ambulance Services Ignoring the Potential of AI to Relieve Pressures. Retrieved March 7, 2023 from https://buildingbetterhealthcare.com/news/article_page/Struggling_ambulance_services_ignoring_the_potential_of_AI_to_relieve_pressures/203185Google Scholar
- Microsoft. 2022. End-To-End Geospatial Storage, Analysis, and Visualization. Retrieved April 17, 2023 from https://learn.microsoft.com/en-us/azure/orbital/geospatial-reference-architectureGoogle Scholar
- United Nations. 2015. Transforming our World: the 2030 Agenda for Sustainable Development. Retrieved March 17, 2023 from https://sdgs.un.org/2030agendaGoogle Scholar
- Newzoo. 2022. Newzoo Global Mobile Market Report. Number of smartphone users by leading countries in 2021 (in millions). Statista. Retrieved March 17, 2023 from https://www.statista.com/statistics/748053/worldwide-top-countries-smartphone-users/Google Scholar
- NOAA. 2022. NOAA National Centers for Environmental Information, Monthly National Climate Report for September 2022. https://www.ncei.noaa.gov/access/monitoring/monthly-report/national/202209Google Scholar
- The City of Columbus. 2023. Service Request Portal. Retrieved March 17, 2023 from https://www.columbus.gov/311serviceportal/Google Scholar
- Department of Homeland Security. 2017. National Incident Management System. Third Edition/. Retrieved March 27, 2023 from https://www.fema.gov/sites/default/files/2020-07/fema_nims_doctrine-2017.pdfGoogle Scholar
- British Association of Public Safety Communications Officials. 2023. Context is Everything. BAPCO Journal 20, 1 (2023), 36--37.Google Scholar
- City of Toronto. 2023. Create Service Request. Retrieved March 17, 2023 from https://www.toronto.ca/home/311-toronto-at-your-service/create-a-service-request/#categoryGoogle Scholar
- Intergovernmental Panel on Climate Change (IPCC). 2022. Climate Change 2022: Impacts, Adaptation and Vulnerability Summary for Policymakers Headline Statements. https://www.ipcc.ch/report/ar6/wg2/resources/spm-headline-statements/Google Scholar
- Protiva Rahman and Arnab Nandi. 2019. Transformer: a Database-driven Approach to Generating Forms for Constrained Interaction. In Proceedings of the 24th International Conference on Intelligent User Interfaces. 485--496.Google ScholarDigital Library
- RedBox. 2023. AI Powered Speech Analytics Supporting Emergency Services. Retrieved March 7, 2023 from https://www.redboxvoice.com/sectors/public-safety-critical-communications/public-safety-analytics/Google Scholar
- LLB Reporter. 2022. Latest NHS Figures Show Ambulance Services Face Toughest Winter Yet. Retrieved March 17, 2023 from https://londonlovesbusiness.com/latest-nhs-figures-show-ambulance-services-face-toughest-winter-yet/Google Scholar
- Enrico Rukzio, Chie Noda, Alexander De Luca, John Hamard, and Fatih Coskun. 2008. Automatic Form Filling on Mobile Devices. Pervasive and Mobile Computing 4, 2 (April 2008), 161--181. https://doi.org/10.1016/j.pmcj.2007.09.001Google ScholarDigital Library
- Salih Sarp, Murat Kuzlu, Mecit Cetin, Cem Sazara, and Ozgur Guler. 2020. Detecting Floodwater on Roadways from Image Data Using Mask-R-CNN. In 2020 International Conference on INnovations in Intelligent SysTems and Applications (INISTA). IEEE, 1--6.Google ScholarCross Ref
- Cem Sazara, Mecit Cetin, and Khan M Iftekharuddin. 2019. Detecting Floodwater on Roadways from Image Data with Handcrafted Features and Deep Transfer Learning. In 2019 IEEE intelligent transportation systems conference (ITSC). IEEE, 804--809.Google Scholar
- Farhana Sultana, Abu Sufian, and Paramartha Dutta. 2018. Advancements in Image Classification Using Convolutional Neural Network. In 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN). IEEE, 122--129.Google Scholar
- United States Geological Survey (USGS). 2023. Coastal Change Hazard Portal. Retrieved March 7, 2023 from https://marine.usgs.gov/coastalchangehazardsportal/info/Google Scholar
- United States Geological Survey (USGS). 2023. National Water Dashboard. Retrieved March 7, 2023 from https://dashboard.waterdata.usgs.gov/app/nwd/en/Google Scholar
- Kristina Wolf, Richard Dawson, Jon Mills, Phil Blythe, Jeremy Morley, and Arnab Nandi. 2023. Supporting Geospatial Climate Hazard Reporting using Computer Vision and Text Generation of Social Media Imagery. 31st Annual Geographical Information Science Research UK Conference (GISRUK), Glasgow, Scotland. https://doi.org/10.5281/zenodo.7834890Google Scholar
- Kristina Wolf, Richard J Dawson, Jon P Mills, Phil Blythe, and Jeremy Morley. 2022. Towards a Digital Twin for Supporting Multi-Agency Incident Management in a Smart City. Scientific reports 12, 1 (2022), 16221.Google Scholar
Recommendations
Identifying First Responders Information Needs: Supporting Search and Rescue Operations for Fire Emergency Response
At the onset of an indoor fire emergency, the availability of the information becomes critical due to the chaotic situation at the emergency site. Moreover, if information is lacking, not shared, or responders are too overloaded to acknowledge it, lives ...
Human roles for robot augmented first response
2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)Emergency incident response varies dramatically based on incident type, size, and response duration. Robots will facilitate response planning and maintaining awareness, remove responders from dangerous situations, and allow for immediate site feedback ...
Beyond First Aid: Emergency Response Teams Turn to Graphics
Whether it is a chemical or biological hazard, a fire, a crime in progress, or a life-threatening health situation, the faster the first responders arrive on the scene, the better. In a large urban area, finding the right building or house can prove ...
Comments