Skip to main content

The Impact of Sentiment in the News Media on Daily and Monthly Stock Market Returns

  • Conference paper
  • First Online:
Data Mining (AusDM 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1504))

Included in the following conference series:

Abstract

Sentiment analysis allows for the subjective information contained within a piece of media to be classified. This subjective information is particularly relevant in the finance domain as opinions and speculation may influence investment decisions and, consequently, affect asset prices. State-of-the-art sentiment classification methods in machine learning use contextual word representations from pre-trained BERT language models and several papers have fine-tuned BERT for the sentiment classification of financial texts. However, these preceding studies have not considered extensive real-world data sets or provided a robust assessment of whether the sentiment scores derived from BERT predict asset prices. This paper addresses these limitations by fine-tuning BERT to analyse the sentiment across an extensive set of news articles published by the Wall Street Journal. The analysis also extends beyond financial news stories, assessing the sentiment in economic and national news articles. An econometric evaluation of the sentiment scores shows that financial news sentiment is statistically significant in predicting daily market returns, while longer-term economic news sentiment predicts monthly returns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For reviews of textual analysis in financial economics see [1, 19, 30, 44].

  2. 2.

    The LDA analysis was performed with a batchsize of 1000, an asymmetric alpha hyperparameter, and 10 passes over the corpus. These parameters were selected as they generate the most interpretable word clusters. The pre-processing steps taken for the LDA included; tokenization; the removal of stopwords; and lemmetization.

  3. 3.

    The Transformer [45] is a deep learning model that, like recurrent neural networks, is designed to handle sequential data. However, the Transformer does not feature the same network structure as an RNN and therefore does not require that the sequential data be processed in order.

  4. 4.

    The economic and national news items were labelled with regard to the tone or emotion–namely positive, negative or neutral–expressed by the article. The subject matter of the article did not effect the sentiment label that was given to it.

References

  1. Algaba, A., Ardia, D., Bluteau, K., Borms, S., Boudt, K.: Econometrics meets sentiment: an overview of methodology and applications. J. Econ. Surv. 34(3), 512–547 (2020)

    Article  Google Scholar 

  2. Antweiler, W., Frank, M.Z.: Is all that talk just noise? the information content of internet stock message boards. J. Finance 59(3), 1259–1294 (2004)

    Article  Google Scholar 

  3. Araci, D.: Finbert: Financial sentiment analysis with pre-trained language models. arXiv preprint arXiv:1908.10063 (2019)

  4. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  5. Boudoukh, J., Israel, R., Richardson, M.: Long-horizon predictability: a cautionary tale. Finan. Anal. J. 75(1), 17–30 (2019)

    Article  Google Scholar 

  6. Boyd, J.H., Hu, J., Jagannathan, R.: The stock market’s reaction to unemployment news: why bad news is usually good for stocks. J. Finance 60(2), 649–672 (2005)

    Article  Google Scholar 

  7. Capelle-Blancard, G., Laguna, M.A.: How does the stock market respond to chemical disasters? J. Environ. Econ. Manage. 59(2), 192–205 (2010)

    Article  Google Scholar 

  8. Chen, C.C., Huang, H.H., Chen, H.H.: Issues and perspectives from 10,000 annotated financial social media data. In: Proceedings of the 12th Language Resources and Evaluation Conference, pp. 6106–6110 (2020)

    Google Scholar 

  9. Chesney, M., Reshetar, G., Karaman, M.: The impact of terrorism on financial markets: an empirical study. J. Bank. Finance 35(2), 253–267 (2011)

    Article  Google Scholar 

  10. Das, S.R., Chen, M.Y.: Yahoo! for amazon: sentiment extraction from small talk on the web. Manage. Sci. 53(9), 1375–1388 (2007)

    Article  Google Scholar 

  11. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  12. Dougal, C., Engelberg, J., Garcia, D., Parsons, C.A.: Journalists and the stock market. Rev. Finan. Stud. 25(3), 639–679 (2012)

    Article  Google Scholar 

  13. Eldor, R., Melnick, R.: Financial markets and terrorism. Eur. J. Polit. Econ. 20(2), 367–386 (2004)

    Article  Google Scholar 

  14. Fama, E.F.: Efficient capital markets: a review of theory and empirical work. J. Finance 25(2), 383–417 (1970)

    Article  Google Scholar 

  15. Friedman, M.: Essays in Positive Economics. University of Chicago Press, Chicago (1953)

    Google Scholar 

  16. Funke, N., Matsuda, A.: Macroeconomic news and stock returns in the united states and Germany. German Econ. Rev. 7(2), 189–210 (2006)

    Article  Google Scholar 

  17. Garcia, D.: Sentiment during recessions. J. Finance 68(3), 1267–1300 (2013)

    Article  Google Scholar 

  18. Garleanu, N., Panageas, S., Yu, J.: Technological growth and asset pricing. J. Finance 67(4), 1265–1292 (2012)

    Article  Google Scholar 

  19. Gentzkow, M., Kelly, B., Taddy, M.: Text as data. J. Econ. Lit. 57(3), 535–74 (2019)

    Article  Google Scholar 

  20. Gino, F., Brooks, A.W., Schweitzer, M.E.: Anxiety, advice, and the ability to discern: feeling anxious motivates individuals to seek and use advice. J. Pers. Soc. Psychol. 102(3), 497 (2012)

    Article  Google Scholar 

  21. Gurun, U.G., Butler, A.W.: Don’t believe the hype: local media slant, local advertising, and firm value. J. Finance 67(2), 561–598 (2012)

    Article  Google Scholar 

  22. Hamilton, J.T.: Pollution as news: media and stock market reactions to the toxics release inventory data. J. Environ. Econ. Manage. 28(1), 98–113 (1995)

    Article  Google Scholar 

  23. Howard, J., Ruder, S.: Universal language model fine-tuning for text classification. arXiv preprint arXiv:1801.06146 (2018)

  24. Jegadeesh, N., Wu, D.: Word power: a new approach for content analysis. J. Finan. Econ. 110(3), 712–729 (2013)

    Article  Google Scholar 

  25. Kaplanski, G., Levy, H.: Sentiment and stock prices: the case of aviation disasters. J. Financ. Econ. 95(2), 174–201 (2010)

    Article  Google Scholar 

  26. Klassen, R.D., McLaughlin, C.P.: The impact of environmental management on firm performance. Manage. Sci. 42(8), 1199–1214 (1996)

    Article  Google Scholar 

  27. Kung, H., Schmid, L.: Innovation, growth, and asset prices. J. Finance 70(3), 1001–1037 (2015)

    Article  Google Scholar 

  28. Larsen, V.H., Thorsrud, L.A.: The value of news for economic developments. J. Econometrics 210(1), 203–218 (2019)

    Article  MathSciNet  Google Scholar 

  29. Loughran, T., McDonald, B.: When is a liability not a liability? textual analysis, dictionaries, and 10-ks. J. Finance 66(1), 35–65 (2011)

    Article  Google Scholar 

  30. Loughran, T., McDonald, B.: Textual analysis in accounting and finance: a survey. J. Acc. Res. 54(4), 1187–1230 (2016)

    Article  Google Scholar 

  31. Loughran, T., McDonald, B.: Textual analysis in finance. Ann. Rev. Financ. Econ. 12, 357–375 (2020)

    Article  Google Scholar 

  32. Malo, P., Sinha, A., Korhonen, P., Wallenius, J., Takala, P.: Good debt or bad debt: detecting semantic orientations in economic texts. J. Assoc. Inf. Sci. Technol. 65(4), 782–796 (2014)

    Article  Google Scholar 

  33. Nardo, M., Petracco-Giudici, M., Naltsidis, M.: Walking down wall street with a tablet: a survey of stock market predictions using the web. J. Econ. Surv. 30(2), 356–369 (2016)

    Article  Google Scholar 

  34. Newey, W.K., West, K.D.: A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica J. Econometric Soc. 55(3), 703–708 (1987)

    Article  Google Scholar 

  35. Řehřek, R., Sojka, P., et al.: Gensim—statistical semantics in python. Retrieved from genism. org (2011)

    Google Scholar 

  36. Renault, T.: Intraday online investor sentiment and return patterns in the us stock market. J. Bank. Finance 84, 25–40 (2017)

    Article  Google Scholar 

  37. Rigobon, R., Sack, B.: The effects of war risk on us financial markets. J. Bank. Finance 29(7), 1769–1789 (2005)

    Article  Google Scholar 

  38. Shapiro, A.H., Sudhof, M., Wilson, D.J.: Measuring news sentiment. J. Econometrics (2020)

    Google Scholar 

  39. Shiller, R.J.: Narrative Economics. Princeton University Press, Princeton (2020)

    Google Scholar 

  40. Sievert, C., Shirley, K.: Ldavis: a method for visualizing and interpreting topics. In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, pp. 63–70 (2014)

    Google Scholar 

  41. Solomon, D.H., Soltes, E., Sosyura, D.: Winners in the spotlight: media coverage of fund holdings as a driver of flows. J. Financ. Econ. 113(1), 53–72 (2014)

    Article  Google Scholar 

  42. Sousa, M.G., Sakiyama, K., de Souza Rodrigues, L., Moraes, P.H., Fernandes, E.R., Matsubara, E.T.: Bert for stock market sentiment analysis. In: 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), pp. 1597–1601. IEEE (2019)

    Google Scholar 

  43. Tetlock, P.C.: Giving content to investor sentiment: the role of media in the stock market. J. Finance 62(3), 1139–1168 (2007)

    Article  Google Scholar 

  44. Tetlock, P.C.: Information transmission in finance. Annu. Rev. Financ. Econ. 6(1), 365–384 (2014)

    Article  Google Scholar 

  45. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  46. Yang, Y., Uy, M.C.S., Huang, A.: Finbert: A pretrained language model for financial communications. arXiv preprint arXiv:2006.08097 (2020)

  47. Zhu, Y., et al.: Aligning books and movies: towards story-like visual explanations by watching movies and reading books. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 19–27 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Justin Case .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Case, J., Clements, A. (2021). The Impact of Sentiment in the News Media on Daily and Monthly Stock Market Returns. In: Xu, Y., et al. Data Mining. AusDM 2021. Communications in Computer and Information Science, vol 1504. Springer, Singapore. https://doi.org/10.1007/978-981-16-8531-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-8531-6_13

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-8530-9

  • Online ISBN: 978-981-16-8531-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics