skip to main content
10.1145/2897683.2897693acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

Mining Twitter data for influenza detection and surveillance

Published:14 May 2016Publication History

ABSTRACT

Twitter --- a social media platform --- has gained phenomenal popularity among researchers who have explored its massive volumes of data to offer meaningful insights into many aspects of modern life. Twitter has also drawn great interest from public health community to answer many health-related questions regarding the detection and spread of certain diseases. However, despite the growing popularity of Twitter as an influenza detection source among researchers, healthcare officials do not seem to be as intrigued by the opportunities that social media offers for detecting and monitoring diseases. In this paper, we demonstrate that 1) Twitter messages (tweets) can be reliably classified based on influenza related keywords; 2) the spread of influenza can be predicted with high accuracy; and, 3) there is a way to monitor the spread of influenza in selected cities in real-time. We propose an approach to efficiently mine and extract data from Twitter streams, reliably classify tweets based on their sentiment, and visualize data via a real-time interactive map. Our study benefits not only aspiring researchers who are interested in conducting a study involving the analysis of Twitter data but also health sectors officials who are encouraged to incorporate the analysis of vast information from social media data sources, in particular, Twitter.

References

  1. Achrekar, H., Gandhe, A., Lazarus, R., Yu, S.-H., and Liu, B. Predicting flu trends using twitter data. In IEEE Conference on Computer Communications Workshops (2011), pp. 702--707.Google ScholarGoogle ScholarCross RefCross Ref
  2. Asta, D., and Shalizi, C. Identifying influenza trends via twitter. In NIPS Workshop on Social Network and Social Media Analysis: Methods, Models and Applications (2012).Google ScholarGoogle Scholar
  3. Asur, S., Huberman, B., et al. Predicting the future with social media. In Proc. of the International Conference on Web Intelligence and Intelligent Agent Technology) (2010), vol. 1, pp. 492--499. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Barbosa, L., and Feng, J. Robust sentiment detection on twitter from biased and noisy data. In Proc. of the 23rd International Conference on Computational Linguistics (2010), pp. 36--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bollen, J., Mao, H., and Zeng, X. Twitter mood predicts the stock market. Journal of Computational Science 2, 1 (2011), 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  6. Chen, L., Achrekar, H., Liu, B., and Lazarus, R. Vision: towards real time epidemic vigilance through online social networks: introducing sneft--social network enabled flu trends. In Proc. of the 1st ACM Workshop on Mobile Cloud Computing & Services: Social Networks and Beyond (2010), p. 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chew, C., and Eysenbach, G. Pandemics in the age of twitter: content analysis of tweets during the 2009 h1n1 outbreak. PloS one 5, 11 (2010), e14118.Google ScholarGoogle Scholar
  8. Culotta, A. Detecting influenza epidemics by analyzing twitter messages. arXiv preprint arXiv:1007.4748 (2010).Google ScholarGoogle Scholar
  9. de Quincey, E., and Kostkova, P. Early warning and outbreak detection using social networking websites: The potential of twitter. In Electronic healthcare. Springer, 2010, pp. 21--24.Google ScholarGoogle Scholar
  10. Eisenstein, J., O'Connor, B., Smith, N. A., and Xing, E. P. A latent variable model for geographic lexical variation. In Proc. of the Conference on Empirical Methods in Natural Language Processing (2010), pp. 1277--1287. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Friedland, G., and Sommer, R. Cybercasing the joint: On the privacy implications of geo-tagging. In HotSec (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., and Brilliant, L. Detecting influenza epidemics using search engine query data. Nature 457, 7232 (2009), 1012--1014.Google ScholarGoogle ScholarCross RefCross Ref
  13. Lampos, V., and Cristianini, N. Tracking the flu pandemic by monitoring the social web. In 2nd International Workshop on Cognitive Information Processing (CIP) (2010), pp. 411--416.Google ScholarGoogle ScholarCross RefCross Ref
  14. O'Connor, B., Balasubramanyan, R., Routledge, B. R., and Smith, N. A. From tweets to polls: Linking text sentiment to public opinion time series. Proc. of the International AAAI Conference on Web and Social Media 11, 122-129 (2010), 1--2.Google ScholarGoogle Scholar
  15. Paul, M. J., and Dredze, M. You are what you tweet: Analyzing twitter for public health. pp. 265--272.Google ScholarGoogle Scholar
  16. Reyes, F., Aziz, S., Macey, J., Li, Y., Winchester, B., Zabchuk, P., Wootton, S., Huston, P., and Tam, T. Influenza in canada. Canada Communicable Disease Report 33, 09 (2007).Google ScholarGoogle Scholar
  17. Ritterman, J., Osborne, M., and Klein, E. Using prediction markets and twitter to predict a swine flu pandemic. In 1st International workshop on mining social media (2009), vol. 9.Google ScholarGoogle Scholar
  18. Sadilek, A., Kautz, H. A., and Silenzio, V. Modeling spread of disease from social interactions. In The International AAAI Conference on Web and Social Media (2012).Google ScholarGoogle Scholar
  19. Sakaki, T., Okazaki, M., and Matsuo, Y. Earthquake shakes twitter users: real-time event detection by social sensors. In Proc. of the 19th international conference on World wide web (2010), pp. 851--860. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Salathe, M., and Khandelwal, S. Assessing vaccination sentiments with online social media: Implications for infectious disease dynamics and control. PLoS Comput Biol 7, 10 (10 2011), e1002199.Google ScholarGoogle Scholar
  21. Scanfeld, D., Scanfeld, V., and Larson, E. L. Dissemination of health information through social networks: Twitter and antibiotics. American journal of infection control 38, 3 (2010), 182--188.Google ScholarGoogle Scholar
  22. Vance, K., Howe, W., and Dellavalle, R. P. Social internet sites as a source of public health information. Dermatologic clinics 27, 2 (2009), 133--136.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    SEHS '16: Proceedings of the International Workshop on Software Engineering in Healthcare Systems
    May 2016
    73 pages
    ISBN:9781450341684
    DOI:10.1145/2897683

    Copyright © 2016 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 14 May 2016

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Upcoming Conference

    ICSE 2025

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader