Skip to main content

Aggregating and Analyzing Articles and Comments on a News Website

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10091))

Abstract

In the top news stories, the commenting activity is rising and falling until it stops. In some ongoing news stories such as disasters like the disappearance of flight MH370, global warming or climate change, political turmoil or economic crisis, this commenting activity cycle can repeat and last many years. To our knowledge, a study and analysis of those data does not exist up to now. There is a need to separate facts, opinions and junk within those comments data. In this paper, we present our framework for supporting readers in analyzing and visualizing facts, opinions and topics in the comments and its extension with comments aggregation and summarization for comments within several news articles for the same event. We added a time-series analysis and comments features such as surprising comments and a preferential threads attachment model.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.theguardian.com/world/malaysia-airlines-flight-mh370.

  2. 2.

    http://neo4j.com.

References

  1. Liu, C.Y., Tseng, C.Y., Chen, M.S.: IncreSTS: towards real-time incremental short text summarization on comment streams from social network services. IEEE Trans. Knowl. Data Eng. 27(11), 2986–3000 (2015). http://doi.ieee.org/10.1109/TKDE.2015.2405553. IEEE Press, New York

    Article  Google Scholar 

  2. Momeni, E., Sageder, G.: An empirical analysis of characteristics of useful comments in social media. In: Proceedings of the Conference on Web Sciences, WebSci 2013, Paris, France, 02–04 May 2013, pp. 258–261. ACM, New York (2013). http://doi.acm.org/10.1145/2464464.2464490

  3. Schinas, M., Papadopoulos, S., Kompatsiaris, Y., Mitkas, P.A.: Visual event summarization on social media using topic modelling and graph-based ranking algorithms. In: Proceedings of the 5th ACM International Conference on Multimedia Retrieval, ICMR 2015, Shanghai, China, 23–26 June 2015, pp. 203–210. ACM, New York (2015). http://doi.acm.org/10.1145/2671188.2749407

  4. Wang, L., Cardie, C., Marchetti, G.: Socially-informed timeline generation for complex events. In: The Proceedings of the 2015 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, 31 May–5 June 2015, pp. 1055–1065. ACL Anthology publisher (2015). http://www.aclweb.org/anthology/N15-1112

  5. Yang, Z., Cai, K., Tang, J., Zhang, L., Su, Z., Li, J.: Social context summarization. In: The Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, 24–28 July 2011, pp. 255–264. ACM, New York (2011)

    Google Scholar 

  6. Potthast, M., Stein, B., Loose, F., Becker, S.: Information retrieval in the commentsphere. ACM Trans. Intell. Syst. Technol. (TIST) 3(4), 68 (2012). ACM, New York

    Google Scholar 

  7. Wanner, F., Ramm, T., Keim, D.A.: ForAVis – explorative user forum analysis. In: Proceedings of the International Conference on Web Intelligence, Mining and Semantics, WIMS 2011, Sogndal, Norway, 25–27 May 2011, pp. 1–10. ACM, New York (2011)

    Google Scholar 

  8. Wanner, F., Schreck, T., Jentner, W., Sharalieva, L., Keim, D.A.: Relating interesting quantitative time series patterns with text events and text features. In: Proceedings of the IS&T/SPIE Volume 9017, Electronic Imaging, International Society for Optics and Photonics, Visualization and Data Analysis 2014, San Francisco, USA, 2 February 2014, pp. 1–15. SPIE, USA (2014). doi:10.1117/12.2039639

  9. Rooney, S.: Using lift as a practical measure of surprise in a document stream. In: The EBW 2015, Proceedings of the 3rd International Conference on E-Technologies and Business on the Web, Paris, France, 26–28 March 2015, pp. 7–12. SDIWC, Hong Kong (2015)

    Google Scholar 

  10. Ramamonjisoa, D., Murakami, R., Chakraborty, B.: A framework for comments analysis and visualization. Int. J. Digit. Inf. Wirel. Commun. (IJDIWC) 5(3), 179–187 (2015). SDIWC, Hong Kong

    Google Scholar 

  11. Gomez, V., Kappen, H.J., Litvak, N., Kaltenbrunner, A.: A likelihood-based framework for the analysis of discussion threads. World Wide Web 16((5-6)), 645–675 (2013). Social Networks and Social Web Mining

    Article  Google Scholar 

  12. Murdock, J., Allen, C.: Visualization techniques for topic model checking. In: Proceedings of the 29th Conference on Artificial Intelligence, AAAI 2015, Austin Texas, USA, 25–30 January 2015, pp. 4284–4285. AAAI Press, USA (2015

    Google Scholar 

  13. Bird, S., Klein, E., Loper, E.: Natural Language Processing with Python, 1st edn. O’Reilly, Sebastopol (2009)

    MATH  Google Scholar 

  14. Ashton, C., Bruce, A.S., Colledge, G., Dickinson, M.: The search for MH370. J. Navig. 68(1), 1–22 (2015). doi:10.1017/S037346331400068X. The Royal Institute of Navigation 2014

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Ramamonjisoa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ramamonjisoa, D. (2017). Aggregating and Analyzing Articles and Comments on a News Website. In: Otake, M., Kurahashi, S., Ota, Y., Satoh, K., Bekki, D. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2015. Lecture Notes in Computer Science(), vol 10091. Springer, Cham. https://doi.org/10.1007/978-3-319-50953-2_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50953-2_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50952-5

  • Online ISBN: 978-3-319-50953-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics