Benjamin Bischke
ABSTRACT
The availability of satellite images for academic or commercial purpose is increasing rapidly due to efforts made by governmental agencies (NASA, ESA) to publish such data openly or commercial startups (PlanetLabs) to provide real-time satellite data. Beyond many commercial application, satellite data is helpful to create situation awareness in disaster recovery and emergency situations such as wildfires, earthquakes, or flooding. To fully utilize such data sources, we present a scalable system for the contextual enrichment of satellite images by crawling and analyzing multimedia content from social media. This information stream can provide vital information from the ground and help to complement remote sensing in situations. We use Twitter as main data source and analyze its textual, visual, temporal, geographical and social dimensions. Visualizations show different aspects of the event allowing high-level comprehension and provide deeper insights into the event as complemented by social media.
- H. Becker, D. Iter, M. Naaman, and L. Gravano. Identifying content for planned events across social media sites. In Proceedings of the Fifth ACM International Conference on Web Search and Data Mining, WSDM '12, pages 533--542, New York, NY, USA, 2012. ACM. Google Scholar
Digital Library
- D. Borth, R. Ji, T. Chen, T. Breuel, and S.-F. Chang. Large-scale visual sentiment ontology and detectors using adjective noun pairs. In Proceedings of the 21st ACM international conference on Multimedia, pages 223--232. ACM, 2013. Google ScholarDigital Library
- T. Chen, D. Borth, T. Darrell, and S. Chang. Deepsentibank: Visual sentiment concept classification with deep convolutional neural networks. CoRR, abs/1410.8586, 2014.Google Scholar
- M. Douze, H. Jégou, H. Sandhawalia, L. Amsaleg, and C. Schmid. Evaluation of gist descriptors for web-scale image search. In Proceedings of the ACM International Conference on Image and Video Retrieval, page 19. ACM, 2009. Google ScholarDigital Library
- K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385, 2015.Google Scholar
- W. He, S. Zha, and L. Li. Social media competitive analysis and text mining: A case study in the pizza industry. International Journal of Information Management, 33(3):464--472, 2013.Google ScholarCross Ref
- M. E. Keim and E. Noji. Emergent use of social media: a new age of opportunity for disaster resilience. American journal of disaster medicine, 6(1):47--54, 2010.Google Scholar
- A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 25, pages 1097--1105. Curran Associates, Inc., 2012. Google ScholarDigital Library
- D. Lazer, A. S. Pentland, L. Adamic, S. Aral, A. L. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, et al. Life in the network: the coming age of computational social science. Science (New York, NY), 323(5915):721, 2009.Google Scholar
- B. R. Lindsay. Social media and disasters: Current uses, future options, and policy considerations, 2011.Google Scholar
- D. Maynard, K. Bontcheva, and D. Rout. Challenges in developing opinion mining tools for social media. Proceedings of the@ NLP can u tag #usergeneratedcontent, pages 15--22, 2012.Google Scholar
- P. J. McParlane, A. J. McMinn, and J. M. Jose. Picture the scene...;: Visually summarising social media events. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pages 1459--1468. ACM, 2014. Google ScholarDigital Library
- L. Palen. Online social media in crisis events. Educause Quarterly, 31(3):76--78, 2008.Google Scholar
- T. Sakaki, M. Okazaki, and Y. Matsuo. Earthquake shakes twitter users: Real-time event detection by social sensors. In Proceedings of the 19th International Conference on World Wide Web, WWW '10, pages 851--860, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- J. Sarasohn-Kahn. The wisdom of patients: Health care meets online social media, 2008.Google Scholar
- C. W. Schmidt. Using social media to predict and track disease outbreaks. Environmental health perspectives, 120(1):A31, 2012.Google Scholar
- K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.Google Scholar
- P. Sobkowicz, M. Kaschesky, and G. Bouchard. Opinion mining in social media: Modeling, simulating, and forecasting political opinions in the web. Government Information Quarterly, 29(4):470--479, 2012.Google ScholarCross Ref
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1--9, 2015.Google ScholarCross Ref
- M. Thelwall, K. Buckley, G. Paltoglou, D. Cai, and A. Kappas. Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology, 61(12):2544--2558, 2010. Google ScholarDigital Library
- B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. Yfcc100m: The new data in multimedia research. Commun. ACM, 59(2):64--73, Jan. 2016. Google ScholarDigital Library
- A. Ulges, D. Borth, and T. M. Breuel. Visual concept learning from weakly labeled web videos. In Video Search and Mining, pages 203--232. Springer, 2010.Google ScholarCross Ref
- A. Ulges, C. Schulze, D. Borth, and A. Stahl. Pornography detection in video benefits (a lot) from a multi-modal approach. In Proceedings of the 2012 ACM international workshop on Audio and multimedia methods for large-scale video analysis, pages 21--26. ACM, 2012. Google ScholarDigital Library
- J. Yin, A. Lampert, M. Cameron, B. Robinson, and R. Power. Using social media to enhance emergency situation awareness. IEEE Intelligent Systems, 27(6):52--59, 2012. Google ScholarDigital Library
Index Terms
- Contextual Enrichment of Remote-Sensed Events with Social Media Streams
Recommendations
Social media user classification: based on social capital expectation, susceptibility, and compulsion loop
ICEC '17: Proceedings of the International Conference on Electronic CommerceSocial media such as Facebook, Instagram and Twitter are originally developed as communication tools among individuals for private conversations. Through the platforms, people share photos, stories and news with their social media friends to interact ...
Hashtag-centric Immersive Search on Social Media
MM '17: Proceedings of the 25th ACM international conference on MultimediaSocial media information distributes in different Online Social Networks (OSNs). This paper addresses the problem integrating the cross-OSN information to facilitate an immersive social media search experience. We exploit hashtag, which is widely used ...
Comments