Abstract
Clicking on the log data saved by the website, using the big data means to analyze and mine the information stored by massive data, many crucial information of website operation can be learned. This paper adopts Hadoop distributed platform, uses HDFS data storage and Hive to analyze log big data, designs a Web log analysis system and expounds the design process of the system.
Foundation item: Philosophy and social science project of heilongjiang province (16EDC04);School-level topics(KJY202002)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yanhui, M.: Big Data Technology Foundation. Tsinghua University Press, Beijing (2016)
Wbite, T.: Hadoop: The Definitive Guide. O’Reilly Media, Sebastopol (2015)
Rutherglen, J.: Hive Programming guide.People Post Press (2013)
Shenzhi, S.: Research on Web Log Data Analysis System Based on Hadoop. Xidian University
[Apache Flume] Official document http://flume.apache.org/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Yu, G., Sun, L., Wang, Y. (2020). Design of Forum Log System Based on Big Data Analysis. In: Jiang, X., Li, P. (eds) Green Energy and Networking. GreeNets 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 333. Springer, Cham. https://doi.org/10.1007/978-3-030-62483-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-62483-5_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62482-8
Online ISBN: 978-3-030-62483-5
eBook Packages: Computer ScienceComputer Science (R0)