Mengfan Tang
ABSTRACT
With an increasing amount of diverse heterogeneous data and information, the methodology of multimedia analysis has become increasingly relevant in solving challenging societal problems such as managing emergency situations during disasters. Using cybernetic principles combined with multimedia technology, researchers can develop effective frameworks for using diverse multimedia (including traditional multimedia as well as diverse multimodal) data for situation recognition, and determining and communicating appropriate actions to people stranded during disasters. We present known issues in disaster management and then focus on emergency situations. We show that an emergency management problem is fundamentally a multimedia information assimilation problem for situation recognition and for connecting people's needs to available resources effectively, efficiently, and promptly. Major research challenges for managing emergency situations are identified and discussed. We also present a intelligently detecting evolving environmental situations, and discuss the role of multimedia micro-reports as spontaneous participatory sensing data streams in emergency responses. Given enormous progress in concept recognition using machine learning in the last few years, situation recognition may be the next major challenge for learning approaches in multimedia contextual big data. The data needed for developing such approaches is now easily available on the Web and many challenging research problems in this area are ripe for exploration in order to positively impact our society during its most difficult times.
- 2011 thailand floods. https://en.wikipedia.org/wiki/2011 Thailand floods.Google Scholar
- Modelling better ood responses in port phillip bay. http://www.csiro.au/en/Research/D61/Areas/Data-for-decisions/Disaster-management/Flood-modelling. Accessed: 2016-07-23.Google Scholar
- A. Acar and Y. Muraki. Twitter for crisis communication: lessons learned from japan's tsunami disaster. International Journal of Web Based Communities, 7(3):392--402, 2011. Google ScholarDigital Library
- L. Barbosa and J. Feng. Robust sentiment detection on twitter from biased and noisy data. In ICCL. Association for Computational Linguistics, 2010. Google ScholarDigital Library
- D. Carney, U. A Getintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zdonik. Monitoring streams: a new class of data management applications. VLDB 2002. Google ScholarDigital Library
- S. De Paratesi and E. Barrett. Hazards and disasters: concepts and challenges. Remote sensing for hazard monitoring and disaster assessment: marine and coastal applications in the Mediterranean region, pages 1--17, 1989.Google Scholar
- L. Derczynski, A. Ritter, S. Clark, and K. Bontcheva. Twitter part-of-speech tagging for all: Overcoming sparse and noisy data. In RANLP, 2013.Google Scholar
- R. Di Salvo, P. Montalto, G. Nunnari, M. Neri, and G. Puglisi. Multivariate time series clustering on geophysical data recorded at mt. etna from 1996 to 2003. Journal of Volcanology and Geothermal Research, 251:65--74, 2013.Google Scholar
- T. E. Drabek. Human system responses to disaster: An inventory of sociological ndings. Springer Science & Business Media, 2012.Google Scholar
- P. S. Earle, D. C. Bowden, and M. Guy. Twitter earthquake detection: earthquake monitoring in a social world. Annals of Geophysics, 54(6), 2012.Google Scholar
- H. Gao, G. Barbier, R. Goolsby, and D. Zeng. Harnessing the crowdsourcing power of social media for disaster relief. Technical report, DTIC, 2011.Google Scholar
- M. F. Goodchild and J. A. Glennon. Crowdsourcing geographic information for disaster response: a research frontier. International Journal of Digital Earth, 3(3):231--241, 2010.Google ScholarCross Ref
- N. Grinberg, M. Naaman, B. Shaw, and G. Lotan. Extracting diurnal patterns of real world activity from social media. In ICWSM, 2013.Google Scholar
- J. D. Hamilton. Time series analysis, volume 2. Princeton university press Princeton, 1994.Google ScholarCross Ref
- R. Hegde, B. Manoj, B. Rao, and R. Rao. Emotion detection from speech signals and its applications in supporting enhanced qos in emergency response. In Proceedings of the 3rd International ISCRAM Conference, 2006.Google Scholar
- A. L. Hughes and L. Palen. Twitter adoption and use in mass convergence and emergency events. International Journal of Emergency Management, 6(3-4):248--260, 2009.Google ScholarCross Ref
- R. Jain and D. Sonnen. Social life networks. IT Professional Magazine, 13(5):8, 2011. Google ScholarDigital Library
- S. Jain, R. C. Shah, W. Brunette, G. Borriello, and S. Roy. Exploiting mobility for energy efficient data collection in wireless sensor networks. Mobile Networks and Applications, 11(3):327--339, 2006. Google ScholarDigital Library
- G.-H. Kim, S. Trimi, and J.-H. Chung. Big-data applications in the government sector. Communications of the ACM, 57(3):78--85, 2014. Google ScholarDigital Library
- Y. Li, J. Huang, and J. Luo. Using user generated online photos to estimate and monitor air pollution in major cities. In ICMCS, page 79. ACM, 2015. Google ScholarDigital Library
- S. Luis, F. C. Fleites, Y. Yang, H.-Y. Ha, and S.-C. Chen. A visual analytics multimedia mobile system for emergency response. In IEEE International Symposium on Multimedia. IEEE, 2011. Google ScholarDigital Library
- B. Manoj and A. H. Baker. Communication challenges in emergency response. Commun. ACM, 50(3):51--53, Mar. 2007. Google ScholarDigital Library
- B. Merz, H. Kreibich, and U. Lall. Multi-variate ood damage assessment: a tree-based data-mining approach. Natural Hazards and Earth System Science , 13(1):53--64, 2013.Google ScholarCross Ref
- W. Min and L. Wynter. Real-time road traffic prediction with spatio-temporal correlations. Transportation Research Part C: Emerging Technologies, 19(4):606--616, Aug. 2011.Google ScholarCross Ref
- A. Musaev, D. Wang, and C. Pu. Multi-hazard detection by integrating social media and physical sensors. In Social Media for Government Services, pages 395--409. Springer, 2015.Google ScholarCross Ref
- S. L. Nimmagadda and H. Dreher. Ontology based data warehouse modeling and mining of earthquake data: prediction analysis along eurasian-australian continental plates. In IEEE ICII, 2007.Google ScholarCross Ref
- M. S. Perry. A framework to support spatial, temporal and thematic analytics over semantic web data. PhD thesis, Wright State University, 2008. Google ScholarDigital Library
- S. Pongpaichet, V. K. Singh, M. Gao, and R. Jain. EventShop: Recognizing Situations in Web Data Streams. In WWW, 2013. Google ScholarDigital Library
- S. Pongpaichet, M. Tang, L. Jalali, and R. Jain. Using photos as micro-reports of events. In ICMR, 2016. Google ScholarDigital Library
- M. Rogers, L. Li, and S. J. Russell. Multilinear Dynamical Systems for Tensor Time Series. In NIPS 2013. Google ScholarDigital Library
- A. Sheth and M. Perry. Traveling the Semantic Web through Space, Time, and Theme. IEEE Internet Computing, 12(2):81--86, Mar. 2008. Google ScholarDigital Library
- V. K. Singh and R. Jain. Situation Recognition using EventShop. Springer; Au age: 1st ed. 2016, 2016. Google ScholarDigital Library
- J. H. Sorensen. Hazard warning systems: Review of 20 years of progress. Natural Hazards Review, 1(2):119--125, 2000.Google ScholarCross Ref
- M. Tang, P. Agrawal, S. Pongpaichet, and R. Jain. Geospatial interpolation analytics for data streams in eventshop. In ICME. IEEE, 2015.Google Scholar
- M. S. Tehrany, B. Pradhan, and M. N. Jebur. Spatial prediction of ood susceptible areas using rule based decision tree (dt) and a novel ensemble bivariate and multivariate statistical models in gis. Journal of Hydrology, 504:69--79, 2013.Google ScholarCross Ref
- S. Vieweg, A. L. Hughes, K. Starbird, and L. Palen. Microblogging during two natural hazards events: what twitter may contribute to situational awareness. In CHI, pages 1079--1088. ACM, 2010. Google ScholarDigital Library
- X. Wang, X. Zhou, and S. Lu. Spatiotemporal data modelling and management: a survey. In ICTOOLS. IEEE, 2000. Google ScholarDigital Library
- N. Wiener et al. Cybernetics. JSTOR, 1948.Google Scholar
- Y. Yang and S.-C. Chen. Multimedia big mobile data analytics for emergency management. E-LETTER, 2015.Google Scholar
- Y. Yang, W. Lu, J. Domack, T. Li, S.-C. Chen, S. Luis, and J. K. Navlakha. Madis: A multimedia-aided disaster information integration system for emergency management. In CollaborateCom. IEEE, 2012.Google ScholarDigital Library
Index Terms
- Research Challenges in Developing Multimedia Systems for Managing Emergency Situations
Recommendations
Emergency response systems: research directions and current challenges
ICC '17: Proceedings of the Second International Conference on Internet of things, Data and Cloud ComputingEmergency response is the most critical phase in emergency management. This primarily returns to the importance of direct interference right after the incident occurrence to save lives and protect properties. Therefore, decision making and resource ...
Multimedia Rescue Systems for Floods
MEDES '17: Proceedings of the 9th International Conference on Management of Digital EcoSystemsIn the recent years, digitalization of disaster management has gained much importance in aspects of response, recovery and mitigation. Often, issues identified in past disaster response and relief efforts include lack of communication, delayed ordering ...
Extraordinary Judging Using Electrodermal Activity and Acceleration for Emergency Rescue Evacuation Support System
ICPPW '14: Proceedings of the 2014 43rd International Conference on Parallel Processing WorkshopsMany people have got injured or lost their lives by sudden occurrences of serious disasters such as fires and terrorism. The fires spread from hour to hour. People may lose ways and have fatal damages. If people take a way, they meet with a terrorist, ...
Comments