Skip to main content

SAR: A Graph-Based System with Text Stream Burst Detection and Visualization

  • Conference paper
  • First Online:
Intelligent Computing & Optimization (ICO 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 866))

Included in the following conference series:

Abstract

Smart city trend with Artificial Intelligence, Internet Of Thing and Data Science has been attracting a lot of attention. Following this trend, smart applications that help users improve their quality of life, as well as work, has been investigating by many researchers. In an era of industry 4.0, collecting and exploiting information automatically is essential so that many studies have proposed models for solving storage problems and supporting efficient data processing. In this paper, we introduce our proposed graph-based system called SAR (Smart Article Reader) that can store, analyze, exploit and visualize text streams. This system first gathers daily articles automatically from online journals. After articles are collected, keywords’ frequency of existence is calculated to rank the importance of keywords, finding worthy topics and visually display the results from user requests. Especially, we present the application of Burst Detection technique for detecting periods of time in which some keywords are unusually popular. This technique is used for finding trends from online journals. In addition, we present our method for rating keywords, which share similar Bursts patterns, based on their term frequencies. We also perform system algorithm testing and evaluation to show its performance and estimate its responding time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kleinberg, J., Bursty and hierarchical structure in streams. Data Mining and Knowledge Discovery, 2003. 7(4): p. 373-397

    Article  MathSciNet  Google Scholar 

  2. Kürüm, E., G.-W. Weber, and C. Iyigun, Early warning on Stock Market Bubbles via methods of optimization, clustering and inverse problems. Annals of Operations Research, 2018. 260(1-2): p. 293-320

    Article  MathSciNet  Google Scholar 

  3. Vlachos, M., et al. Identifying similarities, periodicities and bursts for online search queries. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data. ACM

    Google Scholar 

  4. Bakkum, D.J., et al., Parameters for burst detection. Frontiers in computational neuroscience, 2014. 7: p. 193

    Article  Google Scholar 

  5. Weng, J., Lee, B.-S.: Event detection in twitter. In: ICWSM, vol. 11, pp. 401–408 (2011)

    Google Scholar 

  6. Romsaiyud, W.: Detecting emergency events and geo-location awareness from twitter streams. In: The International Conference on E-Technologies and Business on the Web (EBW2013). The Society of Digital Information and Wireless Communication (2013)

    Google Scholar 

  7. Fung, G.P.C., et al.: Parameter free bursty events detection in text streams. In: Proceedings of the 31st International Conference on Very Large Data Bases. VLDB Endowment (2005)

    Google Scholar 

  8. van Pelt, J., et al., Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks. IEEE Transactions on Biomedical Engineering, 2004. 51(11): p. 2051-2062

    Article  Google Scholar 

  9. Wagenaar, D., DeMarse, T.B., Potter, S.M.: MeaBench: a toolset for multi-electrode data acquisition and on-line analysis. In: 2nd International IEEE EMBS Conference on Neural Engineering, 2005. Conference Proceedings. IEEE (2005)

    Google Scholar 

  10. Lee, S., Y. Park, and W.C. Yoon, Burst analysis for automatic concept map creation with a single document. Expert Systems with Applications, 2015. 42(22): p. 8817-8829

    Article  Google Scholar 

  11. Lee, D., Lee, W.: Finding maximal frequent itemsets over online data streams adaptively. In: Fifth IEEE International Conference on Data Mining (ICDM’05). IEEE (2005)

    Google Scholar 

  12. Heydari, A., et al., Detection of review spam: A survey. Expert Systems with Applications, 2015. 42(7): p. 3634-3642

    Article  MathSciNet  Google Scholar 

  13. Zhang, Y., W. Hua, and S. Yuan, Mapping the scientific research on open data: A bibliometric review. Learned Publishing, 2018. 31(2): p. 95-106

    Article  Google Scholar 

  14. Khaing, P.P., New, N.: 2017 IEEE/ACIS 16th International Conference on Adaptive methods for efficient burst and correlative burst detection. in Computer and Information Science (ICIS), IEEE (2017)

    Google Scholar 

  15. Yamamoto, S., et al., Twitter user tagging method based on burst time series. International Journal of Web Information Systems, 2016. 12(3): p. 292-311

    Article  MathSciNet  Google Scholar 

  16. Hong, T.V.T., Do, P.: Developing a graph-based system for storing, exploiting and visualizing text stream. In: Proceedings of the 2nd International Conference on Machine Learning and Soft Computing. ACM (2018)

    Google Scholar 

Download references

Acknowledgements

This research is funded by Vietnam National University Ho Chi Minh City (VNU-HCMC) under the grant number B2017-26-02.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tham Vo Thi Hong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hong, T.V.T., Do, P. (2019). SAR: A Graph-Based System with Text Stream Burst Detection and Visualization. In: Vasant, P., Zelinka, I., Weber, GW. (eds) Intelligent Computing & Optimization. ICO 2018. Advances in Intelligent Systems and Computing, vol 866. Springer, Cham. https://doi.org/10.1007/978-3-030-00979-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00979-3_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00978-6

  • Online ISBN: 978-3-030-00979-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics