skip to main content
10.1145/3484824.3484890acmotherconferencesArticle/Chapter ViewAbstractPublication PagesdsmlaiConference Proceedingsconference-collections
research-article

Correlation of Sentiment Analysis between Tweets and Newspaper Headlines Using NLP

Authors Info & Claims
Published:13 January 2022Publication History

ABSTRACT

Twitter has grown in popularity during the past decades. It is now used by millions of users who share information about their daily life and their opinions on certain topics in the media. In order to automatically process and analyse this data, applications can rely on analysis methods such as sentiment analysis. This study aimed to find correlations between the sentiments of tweets and newspaper headlines in the Namibian context. It focused on using Twitter because of its limitation in the length of the text content posted on this platform.

The study revealed the correlation between the sentiments of Tweets posted from Namibia and that of national headlines appearing in local newspapers.

The study is carried out using Design and Creation Method as it involves capturing data from the Twitter social media platform using an application that has been developed to the needs of the study, headlines from Namibian newspapers namely The Namibian, New Era, Namibian SUN, Informante and Confidente have been captured manually. This application will also track the sentiment score of Namibian tweets in real time. Additionally, the study also made use of the Qualitative and Quantitative Research Methods to analysed and draw conclusions from the collected qualitative data.

The study analysed the sentiment score of the tweets and the newspaper headlines collected, the sentiment scores were graphically plotted to find the sentiment correlation between tweets and newspaper headlines, as well as notable trends. Real-time sentiment analysis of tweets was also carried out to determine the sentiment score of Namibian tweets over a certain period particularly days and months.

This study showed us that there is a direct sentiment correlation between tweets and news headlines, whenever the sentiment score of news headlines drops that of tweets drops as well, and this is more evident when looking at the monthly correlation graph in the results section. This implies that news headlines are one of the drivers of social media content in Namibia.

References

  1. A. Goel, J. Gautam, and S. Kumar, "Real time sentiment analysis of tweets using Naive Bayes," 2016, pp. 257--261.Google ScholarGoogle Scholar
  2. T. Schreiner, "Information, Opinion, or Rumor? The Role of Twitter During the Post-Electoral Crisis in Côte d'Ivoire," Social Media + Society, vol. 4, no. 1, p. 205630511876573, Jan. 2018.Google ScholarGoogle ScholarCross RefCross Ref
  3. H. T. Gemilang, A. Erwin, and K. I. Eng, "Indonesian president candidates 2014 sentiment analysis by using Twitter data," 2014, pp. 101--104.Google ScholarGoogle Scholar
  4. H. Thakkar and D. Patel, "Approaches for Sentiment Analysis on Twitter: A State-of-Art study," p. 8, May 2018.Google ScholarGoogle Scholar
  5. natural language processing definition - Google Search." [Online]. Available: https://www.google.com.na/search?q=natural+language+processing+definition&rlz=1C1CHBD_enNA800NA800&oq=natural+language+processing+definition&aqs=chrome.0.0l6.16102j1j4&sourceid=chrome&ie=UTF-8. [Accessed: 14-Nov-2018].Google ScholarGoogle Scholar
  6. sentiment analysis | Definition of sentiment analysis in English by Oxford Dictionaries." [Online]. Available: https://en.oxforddictionaries.com/definition/sentiment_analysis. [Accessed: 12-Nov-2018].Google ScholarGoogle Scholar
  7. H. Wang, D. Can, A. Kazemzadeh, F. Bar, and S. Narayanan, "A System for Real-time Twitter Sentiment Analysis of 2012 U.S. Presidential Election Cycle," in Proceedings of the ACL 2012 System Demonstrations, Jeju Island, Korea, 2012, pp. 115--120.Google ScholarGoogle Scholar
  8. M. Bhumika, "Analysis of Various Sentiment Classification Techniques," International Journal of Computer Applications, vol. 140, no. 3, pp. 22--27. Apr. 2016.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Baj-Rogowska, "Sentiment Analysis of Facebook Posts: The Uber Case," Dec. 2017.Google ScholarGoogle Scholar
  10. K. Wilfred Kiprono, "Comparative Twitter Sentiment Analysis Based on Linear and Probabilistic Models," International Journal on Data Science and Technology, vol. 2, no. 4, p. 41, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  11. A. Goel, J. Gautam, and S. Kumar, "Real time sentiment analysis of tweets using Naive Bayes," 2016, pp. 257--261.Google ScholarGoogle Scholar
  12. D. Quercia, J. Ellis, L. Capra, and J. Crowcroft, "Tracking 'gross community happiness' from tweets," 2012, p. 965.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Natural Language Toolkit --- NLTK 3.3 documentation." [Online]. Available: https://www.nltk.org/. [Accessed: 21-May-2018].Google ScholarGoogle Scholar
  14. B. Oates, Researching Information Systems and Computing. London: SAGE Publications, 2006.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Twitter API Tutorial. [Online]. Available: http://socialmediaclass.org/twittertutorial.html. [Accessed: 11-Nov-2018].Google ScholarGoogle Scholar
  16. H. Kim, S. M. Jang, S.-H. Kim, and A. Wan, "Evaluating Sampling Methods for Content Analysis of Twitter Data," Social Media + Society, vol. 4, no. 2, p. 205630511877283, Apr. 2018.Google ScholarGoogle Scholar
  17. TextBlob Sentiment: Calculating Polarity and Subjectivity." [Online]. Available: https://planspace.org/20150607-textblob_sentiment/. [Accessed: 22-Nov-2018].Google ScholarGoogle Scholar
  18. 41 Incredible Instagram Statistics you Need to Know," Brandwatch. [Online]. Available: https://www.brandwatch.com/blog/instagram-stats/. [Accessed: 21-Nov-2018].Google ScholarGoogle Scholar
  19. Top 20 Facebook Statistics - Updated November 2018," Zephoria Inc., 20-Nov-2018.Google ScholarGoogle Scholar
  20. TextBlob: Simplified Text Processing --- TextBlob 0.16.0 documentation'. https://textblob.readthedocs.io/en/dev/ (accessed May 21, 2021).Google ScholarGoogle Scholar
  21. A. Kulkarni and A. Shivananda, 'Exploring and Processing Text Data', in Natural Language Processing Recipes: Unlocking Text Data with Machine Learning and Deep Learning using Python, A. Kulkarni and A. Shivananda, Eds. Berkeley, CA: Apress, 2019, pp. 37--65. doi: 10.1007/978-1-4842-4267-4_2.Google ScholarGoogle ScholarCross RefCross Ref
  22. K. H. Manguri, R. N. Ramadhan, and P. R. M. Amin, 'Twitter Sentiment Analysis on Worldwide COVID-19 Outbreaks', Kurdistan Journal of Applied Research, pp. 54--65. May 2020, doi: 10.24017/covid.8.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Correlation of Sentiment Analysis between Tweets and Newspaper Headlines Using NLP

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            DSMLAI '21': Proceedings of the International Conference on Data Science, Machine Learning and Artificial Intelligence
            August 2021
            415 pages
            ISBN:9781450387637
            DOI:10.1145/3484824

            Copyright © 2021 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 13 January 2022

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited
          • Article Metrics

            • Downloads (Last 12 months)23
            • Downloads (Last 6 weeks)1

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader