skip to main content
10.1145/3289430.3289471acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbdiotConference Proceedingsconference-collections
research-article

Crawling and Visualization of Book Evaluation Data from Internet

Published: 24 October 2018 Publication History

Abstract

The explosive development of the Internet means that the number of Internet data has been countless. On this basis, with the increasing popularity of e-commerce platforms and the convenience of online shopping, more and more people are choosing to purchase the goods they need online. For online shopping products, it is not possible to directly observe trials, which often causes people to have certain influence on the judgment of the performance of the products sold. This paper uses data crawling and visualization to display a large amount of book evaluation data to online shopping users. This paper mainly studies and implements the visualization system design method of book evaluation data. Firstly, the python-based online shopping book evaluation data crawling method is implemented, and the shutdown step includes requesting a webpage, obtaining book rating data, connecting a MYSQL database, and storing book rating data; Then, the cleaning and sorting extracts the crawled online sales book evaluation data from the MYSQL database and performs word frequency statistics. In order to display the cleaned up book evaluation data, a python-based data visualization method is implemented, and a word cloud map is generated. Finally, the method is designed and implemented, and a visualization system for book evaluation data is realized. The system is stable and reliable, and the effect is good.

References

[1]
Dong Rizhuang, Guo Yuchao. Design and Implementation of Web Crawler{J}. Computer Knowledge and Technology, 2014, 10(17): 3986--3988+.
[2]
Yao Lintao. Implementation of Web search engine based on Lucene {D}. Xidian University, 2008.
[3]
Yu Juan, Liu Qiang. Summary of Research on Topic Web Reptiles{J}. Computer Engineering and Science, 2015, 37(02): 231--237.
[4]
Tang Zesheng. Visualization of 3D Data Fields {M}. Beijing: Tsinghua Publishing House, 1999.
[5]
Yan Ting, Wen Xinxiu, Zhao Jiahao, et al. Design and Implementation of Visual Data Analysis Platform Based on Python{J}. Journal of Computer Age, 2017(12): 54--56.
[6]
Guo Lirong. Design of Web crawler based on Python{J}. Electronic Technology and Software Engineering, 2017(23): 248--249.
[7]
Amber Spackman Jones, Jeffery S. Horsburgh, Douglas Jackson-Smith, et al. A web-based, interactive visualization tool for social environmental survey data{J}. Environmental Modelling and Software, 2016, 84

Cited By

View all
  • (2021)RETRACTED ARTICLE: Implementation of python data in online translation crawler website designInternational Journal of System Assurance Engineering and Management10.1007/s13198-021-01215-714:1(484-484)Online publication date: 21-Aug-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
BDIOT '18: Proceedings of the 2018 2nd International Conference on Big Data and Internet of Things
October 2018
217 pages
ISBN:9781450365192
DOI:10.1145/3289430
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • Deakin University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. book evaluation data
  2. data cleaning
  3. web crawler
  4. word cloud map

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

BDIOT 2018

Acceptance Rates

Overall Acceptance Rate 75 of 136 submissions, 55%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2021)RETRACTED ARTICLE: Implementation of python data in online translation crawler website designInternational Journal of System Assurance Engineering and Management10.1007/s13198-021-01215-714:1(484-484)Online publication date: 21-Aug-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media