Skip to main content

Are Amazon.com Online Review Helpfulness Ratings Biased or Not?

  • Conference paper
E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life (WEB 2011)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 108))

Included in the following conference series:

Abstract

The helpfulness rating of Amazon product review, a popular vote feature used by Amazon to rank product reviews and display them to online shoppers, has important implications for online shopping decisions. This research investigates how objective those helpfulness ratings are. The general assumption is that the ratings are "representative" views of the shoppers. However, previous studies on product reviews indicate bias may also exist among helpfulness ratings. Using the survey questionnaire, the study found that there were indeed significant differences between the helpfulness ratings displayed at Amazon.com and those from a simulated online shopper population. The survey results also show that there are evidences of rating differences by gender, age, ethnicity, income and mobile device use for shopping. Thus the "true" ratings on online user reviews may well be quite different from what we see at Amazon.com. Implications and limitations of this research are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wan, Y., Menon, S., Ramaprasad, A.: A Classification of Product Comparison Agents. Communications of the ACM 50, 65–71 (2007)

    Article  Google Scholar 

  2. Chen, Y., Xie, J.: Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix. Management Science 54, 477–491 (2008)

    Article  Google Scholar 

  3. Maes, P.: Agents that reduce work and information overload. Communications of the ACM 37, 30–40 (1994)

    Article  Google Scholar 

  4. Senecal, S., Nantel, J.: The influence of online product recommendations on consumers’ online choices. Journal of Retailing 80, 159–169 (2004)

    Article  Google Scholar 

  5. Mackiewicz, J.: Reviewer bias and credibility in online reviews. In: 72nd Annual Convention of the Association for Business Communication, Washington, D.C. (2007)

    Google Scholar 

  6. Dellarocas, C.: Online reputation systems: how to design one that does what you need. MIT Sloan Management Review 51, 33–38 (2010)

    Google Scholar 

  7. Brian Arthur, W., Ermoliev, Y.M., Kaniovski, Y.M.: Path-dependent processes and the emergence of macro-structure. European Journal of Operational Research 30, 294–303 (1987)

    Article  Google Scholar 

  8. Kapoor, G., Piramuthu, S.: Sequential bias in online product reviews. Journal of Organizational Computing and Electronic Commerce 19, 85–95 (2009)

    Article  Google Scholar 

  9. Salganik, M.J., Dodds, P.S., Watts, D.J.: Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market. Science 311, 3 (2006)

    Article  Google Scholar 

  10. Li, X., Hitt, L.M.: Self-Selection and Information Role of Online Product Reviews. Information Systems Research 19, 456–474 (2008)

    Article  Google Scholar 

  11. Wang, C., Zhang, X., Hann, I.-H.: Social bias in online product ratings: a quasi-experimental analysis. In: WISE 2010, St. Louis, MO (2010)

    Google Scholar 

  12. Jurca, R., Garcin, F., Talwar, A., Faltings, B.: Reporting incentives and biases in online review forums. ACM Transactions on the Web 4, 1–27 (2010)

    Article  Google Scholar 

  13. Hu, N., Zhang, J., Pavlou, P.A.: Overcoming the J-shaped distribution of product reviews. Communications of the ACM 52, 144–147 (2009)

    Article  Google Scholar 

  14. Nelson, P.: Information and consumer behavior. Journal of Political Economy 78, 311–329 (1970)

    Article  Google Scholar 

  15. Darby, M.R., Kami, E.: Free Competition and the Optimal Amount of Fraud. Journal of Law and Economics 16, 66–86 (1973)

    Article  Google Scholar 

  16. Nelson, P.: Advertising as information. Journal of Political Economy 82, 729–754 (1974)

    Article  Google Scholar 

  17. Gravetter, F.J., Wallnau, L.B.: Statistics for the Behavioral Sciences. Wadsworth, Belmont (2009)

    Google Scholar 

  18. Mudambi, S.M., Schuff, D.: What makes a helpful online review? a study of customer reviews on Amazon.com. MIS Quarterly 34, 185–200 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wan, Y., Nakayama, M. (2012). Are Amazon.com Online Review Helpfulness Ratings Biased or Not?. In: Shaw, M.J., Zhang, D., Yue, W.T. (eds) E-Life: Web-Enabled Convergence of Commerce, Work, and Social Life. WEB 2011. Lecture Notes in Business Information Processing, vol 108. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29873-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29873-8_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29872-1

  • Online ISBN: 978-3-642-29873-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics