To whom should I listen? Finding reputable reviewers in opinion-sharing communities

https://doi.org/10.1016/j.dss.2012.03.003Get rights and content

Abstract

Online opinion-sharing communities, which allow members to express personal opinions and preferences about specific products, provide important channels for consumers to learn about product quality and support their purchase decision process. Firms can use these reviews to understand customers' responses to their products and improve their products accordingly. Furthermore, opinion-sharing communities provide an alternative, effective marketing channel to firms by offering electronic word of mouth (eWOM). However, due to the openness and anonymity of opinion-sharing communities, their members face a challenging issue, that is, whether to believe or disbelieve information provided by other members. This study attempts to discriminate members (i.e., reviewers) with a high reputation from those with a low reputation on the basis of members' web trust network and review behaviors in an opinion-sharing community. We collected sample data pertaining to four product categories from Epinions.com to test our research model. The results indicate that four variables (trust intensity, average trust intensity of trustors, degree of review focus in the target category, and average product rating in the target category) successfully discriminate reviewers into the two groups, and product type is a significant control variable. These findings not only help firms identify reputable reviewers for marketing campaign purposes but also enable the members of an opinion-sharing community to determine who reputable reviewers are and whose reviews they should trust.

Highlights

► Our model discriminates high-reputation reviewers from low-reputation reviewers. ► Factors derived from members' web trust network and review behavior were examined. ► Our proposed reputation estimation model can supplement the user-driven approach.

Introduction

With the rapid proliferation of e-commerce and Web 2.0 innovations, the Web has become an excellent platform for gathering and sharing consumers’ personal views on, preferences for, and experiences with products [8], [11], [13], [16], [44]. Many third-party product review websites (e.g., Epinions.com,1 rateitall.com, Cnet.com, Edutainingkids.com, ZDNET.com) have established opinion-sharing communities to facilitate the exchange of consumer reviews about a variety of products. It also has become a common practice for retailers (e.g., amazon.com, target.com, bestbuy.com, tripadvisor.com, Shopping.com, Walmart.com) and product manufacturers (e.g., Hewlett-Packard, Nike, Levi's) to create their own opinion-sharing communities, where customers can express their opinions about products they have purchased or in which they are interested.

Consumer reviews are essential to firms (both retailers and product manufacturers) in their efforts to understand the general responses of customers to their products and improve their products accordingly [44]. In addition, opinion-sharing communities provide an alternative, more effective marketing channel to firms, in the form of electronic word of mouth (eWOM), that does not require huge advertising investments [18], [42]. Accordingly, prior studies indicate that consumer reviews can increase sales [5], [6], [13], [15], [27], and the presence of customer reviews on a company's website can improve customer perceptions of the website's usefulness and social presence [26], attract customer visits, increase the time spent on the site (i.e., stickiness), and create a sense of community among frequent shoppers [32].

From a customer perspective, consumer reviewers offer a key information source about product quality [6], [10], [19] and thus can facilitate purchase decision processes [32]. However, as the number of reviews in an opinion-sharing community increases, it becomes more difficult for a member to search or browse through the many reviews contributed by other members to obtain sufficient and useful information. The search process can be not only time consuming but also frustrating, because the quality of consumer reviews varies greatly. Some reviewers appear professional and devoted to the task, but others are subjective and biased. An even more serious concern arises from the openness and pseudo-anonymity of opinion-sharing communities, which confronts members with a challenging issue: should they believe or disbelieve the information provided by other members in the opinion-sharing communities [49]? Consumer reviews can be manipulated easily by interested parties [9]. For example, firms might anonymously post positive reviews of their own products to increase customers’ awareness and perceptions of those products.

One solution to this challenge is a reputation mechanism that reveals the reputation of reviewers who participate in an opinion-sharing community [8], [39]. With such a mechanism, members in the opinion-sharing community can attend to the reviews contributed by more reputable reviewers and avoid those written by less reputable reviewers. The firms also can promote new products to reputable reviewers, with the hope they will like the products and write favorable reviews. Many third-party product review websites (e.g., epinions.com, rateitall.com, ZDNET.com) and opinion-sharing communities hosted by retailers or manufacturers (e.g., Amazon.com, Walmart.com, Nike, Levi's) attempt a peer-evaluation-based approach (i.e., explicit reputation system) that enables members to evaluate and rate the reviews of other members. The site then can aggregate these evaluations (e.g., taking their average) as a measure of the reputation of a reviewer. While this practice appears feasible and involves straightforward computations for reputation estimation, whether to calculate reputation scores for members in the community or classify members into different reputation categories, this user-driven approach also suffers some limitations.

First, for comprehensive coverage, this approach requires at least one user evaluation on some reviews of each reviewer. If none of the reviews written by a reviewer ever gets evaluated by other members, his or her reputation cannot be derived. However, members may not bother to provide feedback (i.e., user evaluation) at all, thus creating a sparsity problem [39]. In addition, similar to other online behaviors, user evaluations tend to be skewed. That is, contributions by some reviewers receive hundreds of user evaluations, whereas others attract no user evaluations. Such sparsity and skewness can result in low coverage and significantly limit the applicability of the user-driven approach to reputation estimation. Second, the user-driven approach is vulnerable to malicious and inflated evaluation behaviors [12], [39]. For example, a member may intentionally give unfavorable evaluations to some members, regardless of the quality of their reviews. Or a member could attempt to inflate his or her own reputation dishonorably, for instance, by creating “fake” members and hiding behind these pseudonyms to create more positive user evaluations to his or her reviews. In both cases, the user-driven approach is ineffective for accurate reputation estimation of the members of an opinion-sharing community.

Motivated by the importance of reputation estimation and the limitations of the user-driven approach, this study develops a reputation estimation model to measure the reputation of a member in an opinion-sharing community. Specifically, our proposed reputation estimation model is based on factors derived from members’ web trust network and review behaviors in an opinion-sharing community. Because we do not rely on information pertaining to user evaluations, our reputation estimation model will not suffer from the limitations inherent to the user-driven approach (i.e., low coverage and vulnerability to malicious and inflated evaluation behaviors). To present this solution, we organize the remainder of our paper as follows: Section 2 reviews literature relevant to this study. We propose our research hypotheses in Section 3. In Section 4, we describe the research methodology and discuss important analysis results. Finally, we conclude with a summary and discussion of some future research directions in Section 5.

Section snippets

Concepts related to reputation

Reputation is defined as “the relative estimation or esteem in which a person or thing is held” [41] or “what is generally said or believed about a person's or thing's character or standing” [21]. In e-commerce environments, reputation refers to the shadow of the future, which supports each transaction made by buyers online. That is, it creates expectations among other users who search for sellers. Users tend to look back on what sellers have done and how they have done it [39], [45], [47].

Research hypotheses

We assume in this study that an opinion-sharing community allows members to (1) write reviews about a variety of products across different product categories, (2) provide product ratings on an ordinal or numeric scale for a variety of products across different product categories, and (3) assert members they trust (forming a web trust network). Information about these activities or behaviors becomes the basis for our reputation estimation. Our assumption about allowable activities in an

Data collection

Park et al. [37] find that third-party-hosted word of mouth is an important source of information for online retail customers and can have a greater influence than retailer-hosted WOM in particular contexts. Thus, an understanding of how to find reputable reviewers in third-party-hosted opinion-sharing communities should be more important to retailers and consumers. In this vein, for our empirical data collection, we target a popular third-party product review website. Specifically, our data

Conclusion

This study focuses on reputation estimations of reviewers in opinion-sharing communities based on factors derived from members' web trust network and their review behaviors. The sample data for this study reflect four product categories from an opinion-sharing community, Epinions.com. The results indicate that four variables (i.e., trust intensity, average trust intensity of trustors, degree of review focus in the target category, and average product rating in the target category) successfully

Acknowledgments

This work was supported in part by the National Science Council of the Republic of China under the grants NSC 96-2416-H-126-009-MY2, NSC 96-2752-H-007-004-PAE, and NSC 100-2410-H-002-021-MY3. The authors would like to thank Luisa Angelica Chen Ng for her data collection effort.

Yi-Cheng Ku is an Assistant Professor at the Department of Computer Science and Information Management at Providence University in Taiwan. He received his Ph.D. in Information Management from National Sun Yat-sen University. In 2009-2010, he was a Fulbright visiting scholar at the College of Management, Georgia Institute of Technology. His research interests include recommendation systems, information system adoption and diffusion, and knowledge management. His research has appeared in Journal

References (49)

  • J.W. Alba et al.

    Dimensions of consumer expertise

    Journal of Consumer Research

    (1987)
  • N. Blaikie

    Analyzing quantitative data

    (2003)
  • Y. Chen et al.

    Third-party product review and firm marketing strategy

    Marketing Science

    (2005)
  • Y. Chen et al.

    Online consumer review: word-of-mouth as a new element of marketing communication mix

    Management Science

    (2008)
  • P.-Y. Chen et al.

    All reviews are not created equal: the disaggregate impact of reviews and reviewers at Amazon.Com. working paper

    (2008)
  • J.A. Chevalier et al.

    The effect of word of mouth on sales: online book reviews

    Journal of Marketing Research

    (2006)
  • N.W. Coppola

    Setting the discourse community: tasks and assessment for the new technical communication service course

    Technical Communication Quarterly

    (1999)
  • C. Dellarocas

    The digitization of word of mouth: promise and challenges of online feedback mechanisms

    Management Science

    (2003)
  • C. Dellarocas

    Strategic manipulation of internet opinion forums: implications for consumers and firms

    Management Science

    (2006)
  • C. Dellarocas et al.

    Exploring the value of online product reviews in forecasting sales: the case of motion pictures

    Journal of Interactive Marketing

    (2007)
  • W. Duan et al.

    Do online reviews matter?—an empirical investigation of panel data

    Decision Support Systems

    (2008)
  • Q. Feng et al.

    Voting systems with trust mechanisms in cyberspace: vulnerabilities and defenses

    IEEE Transactions on Knowledge and Data Engineering

    (2010)
  • C. Forman et al.

    Examining the relationship between reviews and sales: the role of reviewer identity disclosure in electronic markets

    Information Systems Research

    (2008)
  • G.R. Franke et al.

    Information content and consumer readership of print ads: a comparison of search and experience products

    Journal of the Academy of Marketing Science

    (2004)
  • A. Ghose et al.

    Designing novel review ranking systems: predicting the usefulness and impact of reviews

  • D. Godes et al.

    Using online conversations to study word of mouth communication

    Marketing Science

    (2004)
  • J.F. Hair et al.

    Multivariate Data Analysis

    (2006)
  • T. Hennig-Thurau et al.

    Electronic word-of-mouth via consumer-opinion platforms: what motivates consumers to articulate themselves on the internet?

    Journal of Interactive Marketing

    (2004)
  • N. Hu et al.

    Do online reviews affect product sales? The role of reviewer characteristics and temporal effects

    Information Technology and Management

    (2008)
  • S. Huang et al.

    Promote product reviews of high quality on e-commerce site

    Pacific Asia Journal of the Association for Information Systems

    (2010)
  • A. Jøsang et al.

    A survey of trust and reputation systems for online service provision

    Decision Support Systems

    (2007)
  • T.R. Knapp

    Treating ordinal scales as interval scales: an attempt to resolve the controversy

    Nursing Research

    (1990)
  • S.Y.X. Komiak et al.

    The effects of personalization and familiarity on trust and adoption of recommendation agents

    MIS Quarterly

    (2006)
  • Y.-C. Ku et al.

    Analysis of web trust networks

  • Cited by (96)

    • How can trustworthy influencers be identified in electronic word-of-mouth communities?

      2021, Technological Forecasting and Social Change
      Citation Excerpt :

      We have not found any research focused on analyzing relationships between the patterns of behavior of reviewers and peer-generated feedback from other users regarding their trustworthiness. At the time of writing this paper, the closest relevant works that can be found are the studies by Bao and Chang (2014) and Ku et al. (2012) and, especially, Banarjee et al. (2017). Unlike our study, these authors use several indicators related to both reviewer activities, such as the number of reviews written, and peer-generated feedback, such as helpfulness votes or number of friends, as independent variables.

    View all citing articles on Scopus

    Yi-Cheng Ku is an Assistant Professor at the Department of Computer Science and Information Management at Providence University in Taiwan. He received his Ph.D. in Information Management from National Sun Yat-sen University. In 2009-2010, he was a Fulbright visiting scholar at the College of Management, Georgia Institute of Technology. His research interests include recommendation systems, information system adoption and diffusion, and knowledge management. His research has appeared in Journal of Management Information Systems (JMIS), Decision Support Systems (DSS), International Journal of Medical Informatics, International Journal of Business, and various conference proceedings.

    Chih-Ping Wei received a BS in Management Science from National Chiao-Tung University in Taiwan, ROC in 1987 and an MS and a Ph.D. in Management Information Systems from the University of Arizona in 1991 and 1996. He is currently a professor of Department of Information Management at National Taiwan University, Taiwan, R.O.C. Prior to joining National Taiwan University in 2010, he was a professor at National Tsing Hua University and National Sun Yat-sen University in Taiwan and a visiting scholar at the University of Illinois at Urbana-Champaign (Fall 2001) and the Chinese University of Hong Kong (Summer 2006 and 2007). His papers have appeared in Journal of Management Information Systems (JMIS), European Journal of Information Systems, Decision Support Systems (DSS), IEEE Transactions on Engineering Management, IEEE Software, IEEE Intelligent Systems, IEEE Transactions on Systems, Man, and Cybernetics, IEEE Transactions on Information Technology in Biomedicine, Journal of the American Society for Information Science and Technology, Information Processing and Management, Journal of Database Management, and Journal of Organizational Computing and Electronic Commerce, etc. His current research interests include knowledge discovery and data mining, text mining and information retrieval, knowledge management, and patent analysis and intelligence. He can be reached at the Department of Information Management, National Taiwan University, Taipei, Taiwan, R.O.C; [email protected].

    Han-Wei Hsiao received a BS in Mathematic from Tunghai University in Taiwan, ROC. in 1990, an MS in Information Science from the National Chiao-Tung University in Taiwan in 1993, and a Ph.D. in Information Management from the National Sun Yat-sen University in Taiwan in 2004. He is currently an assistant professor of Department of Information Management at National University of Kaohsiung in Taiwan, R.O.C. His papers have appeared in Decision Support Systems, Information Processing and Management, Journal of Internet Technology, etc. His current research interests include data mining, information retrieval and text mining, Internet security, and network management. He can be reached at the Department of Information Management, National University of Kaohsiung, Kaohsiung, Taiwan, R.O.C; [email protected].

    View full text