skip to main content
10.1145/3421537.3421543acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbdiotConference Proceedingsconference-collections
research-article

Mining Relationships among Online Review Texts and Ratings in Indonesian E-commerce Websites

Published:05 October 2020Publication History

ABSTRACT

As the most growing sector for Indonesia's internet economy during the last five years, e-commerce generates online customer reviews that can be a source for information and giving hints for potential improvements for various stakeholders. Online reviews consist of review text and rating, each of which describes customer's concern and satisfaction in purchasing items online. However, online review text is unstructured, and its relation with rating is hardly observed. This study examines 132,085 online reviews about Xiaomi mobile phones on three major e-commerce websites in Indonesia: Shopee, Bukalapak, and Blibli by text mining and quantitative modeling to correlate reviews with ratings. Online reviews are classified into eight distinct topics, and the relationships between each topic and review rating are analyzed. Multilinear regression is implemented to examine the valence and strength in the relationship between each topic-rating. The result shows that there are more topics with a negative relationship with rating, with several topic differences between the three websites. Further improvements should be focused on the most impactful topics, which are referred to the mobile phone features, such as CPU & hardware, system, and physical appearance. After-sales service is also concerned at Bukalapak and Blibli. These relationships are explained further by the valence expressed by customers in review texts. The implications of this study can be applied for academic purposes, e-commerce companies, customers, sellers, and mobile phone companies.

References

  1. Google, Temasek, and Bain, "e-Conomy SEA 2019 Report," 2019.Google ScholarGoogle Scholar
  2. T. Hennig-Thurau, K. P. Gwinner, G. Walsh, and D. D. Gremler, "Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet?," J. Interact. Mark, 2004, doi: 10.1002/dir.10073.Google ScholarGoogle Scholar
  3. R. Chen and W. Xu, "The determinants of online customer ratings: a combined domain ontology and topic text analytics approach,"Electron. Commer. Res., vol. 17, no. 1, pp. 31--50, 2017, doi: 10.1007/s10660-016-9243-6.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. X. Lehto, J. K. Park, O. Park, and M. R. Lehto, "Text analysis of consumer reviews: The case of virtual travel firms," in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2007.Google ScholarGoogle Scholar
  5. C. Tang and L. Guo, "Digging for gold with a simple tool: Validating text mining in studying electronic word-of-mouth (eWOM) communication," Mark. Lett., 2013, doi: 10.1007/s11002-013-9268-8.Google ScholarGoogle Scholar
  6. Z. Hou, F. Cui, Y. Meng, T. Lian, and C. Yu, "Opinion mining from online travel reviews: A comparative analysis of Chinese major OTAs using semantic association analysis," Tour. Manag., vol. 74, pp. 276--289, 2019, doi: 10.1016/j.tourman.2019.03.009.Google ScholarGoogle ScholarCross RefCross Ref
  7. Y. H. Hu, Y. L. Chen, and H. L. Chou, "Opinion mining from online hotel reviews - A text summarization approach," Inf. Process. Manag., 2017, doi: 10.1016/j.ipm.2016.12.002.Google ScholarGoogle Scholar
  8. X. Liu, M. Schuckert, and R. Law, "Utilitarianism and knowledge growth during status seeking: Evidence from text mining of online reviews," Tour. Manag., 2018, doi: 10.1016/j.tourman.2017.11.005.Google ScholarGoogle ScholarCross RefCross Ref
  9. S. S. Jia, "Behind the ratings: Text mining of restaurant customers' online reviews," Int. J. Mark. Res., vol. 60, no. 6, pp. 561--572, 2018, doi: 10.1177/1470785317752048.Google ScholarGoogle ScholarCross RefCross Ref
  10. X. L. Fu, J. Wu, J. Chen, and S. Liu, "Attribute-sentiment pair correlation model based on online user reviews," J. Sensors, vol. 2019, p. 2456752, 2019, doi: 10.1155/2019/2456752.Google ScholarGoogle ScholarCross RefCross Ref
  11. H. Zhang, H. Rao, and J. Feng, "Product innovation based on online review data mining: a case study of Huawei phones," Electron. Commer. Res., vol. 18, no. 1, pp. 3--22, 2018, doi: 10.1007/s10660-017-9279-2.Google ScholarGoogle ScholarCross RefCross Ref
  12. Iprice, "Peta E-Commerce Indonesia," 2018.Google ScholarGoogle Scholar
  13. We Are Social, "Digital 2020: Indonesia," 2020.Google ScholarGoogle Scholar
  14. Euromonitor, "Consumer Electronics in Indonesia," 2019.Google ScholarGoogle Scholar
  15. Euromonitor, "Mobile Phones in Indonesia," 2019.Google ScholarGoogle Scholar
  16. Y. Chen and J. Xie, "Online consumer review: Word-of-mouth as a new element of marketing communication mix," Manage. Sci., 2008, doi: 10.1287/mnsc.1070.0810.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. C. M. K. Cheung, B. S. Xiao, and I. L. B. Liu, "Do actions speak louder than voices? the signaling role of social information cues in influencing consumer purchase decisions," Decis. Support Syst., 2014, doi: 10.1016/j.dss.2014.05.002.Google ScholarGoogle Scholar
  18. E. A. Stepanov and G. Riccardi, "Detecting general opinions from customer surveys," in Proceedings - IEEE International Conference on Data Mining, ICDM, 2011, doi: 10.1109/ICDMW.2011.63.Google ScholarGoogle Scholar
  19. D. H. Park and J. Lee, "eWOM overload and its effect on consumer behavioral intention depending on consumer involvement," Electron. Commer. Res. Appl., 2008, doi: 10.1016/j.elerap.2007.11.004.Google ScholarGoogle Scholar
  20. R. V. Kozinets, "The field behind the screen: Using netnography for marketing research in online communities," J. Mark. Res., 2002, doi: 10.1509/jmkr.39.1.61.18935.Google ScholarGoogle Scholar
  21. Y. Liu, "Word of mouth for movies: Its dynamics and impact on box office revenue," Journal of Marketing. 2006, doi: 10.1509/jmkg.70.3.74.Google ScholarGoogle Scholar
  22. T. Kwartler, Text Mining in Practice with R. Wiley, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  23. A. Y. L. Chong, E. Ch'ng, M. J. Liu, and B. Li, "Predicting consumer product demands via Big Data: the roles of online promotional marketing and online reviews," Int. J. Prod. Res., vol. 55, no. 17, pp. 5142--5156, 2017, doi: 10.1080/00207543.2015.1066519.Google ScholarGoogle ScholarCross RefCross Ref
  24. A. F. Hidayatullah and M. R. Ma'Arif, "Pre-processing Tasks in Indonesian Twitter Messages," J. Phys. Conf. Ser., vol. 801, no. 012072, 2017, doi: 10.1088/1742-6596/801/1/012072.Google ScholarGoogle Scholar
  25. C. D. Manning, P. Raghavan, and H. Schutze, Introduction to Information Retrieval. Cambridge University Press, Cambridge, England, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  26. F. Z. Tala, "A Study of Stemming Effects on Information Retrieval in Bahasa Indonesia," Universiteit van Amsterdam, 2003.Google ScholarGoogle Scholar
  27. J. C. Donohue, Understanding Scientific Literatures: A Bibliometric Approach. Massachusetts, USA: MIT Press, 1973.Google ScholarGoogle Scholar
  28. S. X. Yang and L. J. Fan, "Survey on review spam of e-commerce sites," Appl. Mech. Mater., vol. 631--632, pp. 1190--1193, 2014, doi: 10.4028/www.scientific.net/AMM.631-632.1190.Google ScholarGoogle Scholar
  29. Y. Zhao, X. Xu, and M. Wang, "Predicting overall customer satisfaction: Big data evidence from hotel online textual reviews," Int. J. Hosp. Manag., 2019, doi: 10.1016/j.ijhm.2018.03.017.Google ScholarGoogle Scholar
  30. M. Ghasemaghaei, S. P. Eslami, K. Deal, and K. Hassanein, "Reviews' length and sentiment as correlates of online reviews' ratings," Internet Res., 2018, doi: 10.1108/IntR-12-2016-0394.Google ScholarGoogle Scholar

Index Terms

  1. Mining Relationships among Online Review Texts and Ratings in Indonesian E-commerce Websites

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      BDIOT '20: Proceedings of the 2020 4th International Conference on Big Data and Internet of Things
      August 2020
      108 pages
      ISBN:9781450375504
      DOI:10.1145/3421537

      Copyright © 2020 ACM

      © 2020 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 October 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate75of136submissions,55%
    • Article Metrics

      • Downloads (Last 12 months)5
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader