Elsevier

Computers in Human Behavior

Volume 45, April 2015, Pages 21-31
Computers in Human Behavior

Exploring factors influencing Chinese user’s perceived credibility of health and safety information on Weibo

https://doi.org/10.1016/j.chb.2014.11.071Get rights and content

Highlights

  • We examine factors affecting Weibo information credibility.

  • Low-level claim extremity increases Weibo information credibility.

  • Negative comments decrease Weibo information credibility.

  • Positive comments have no significant effect on credibility.

  • The effect of message popularity depends on prior trust on the information.

Abstract

The spread of non-credible health and safety information on microblog sites may lead to serious consequences when people use such sites as the basis for critical decisions. This study investigated the factors influencing Chinese microblog users’ perception of the credibility of health and safety information. Credibility cues related to the source (source credentials), the message (claim extremity and claim type), and the distribution in personal networks (type of comments, source of comments, and the number of reposts of a message) were examined. Three experiments were conducted on a mocked up Weibo system with 80 participants. The results show that objective claims with low extremity increased perceived information credibility when the participants were highly involved with the issue and had enough prior knowledge. When the participants had insufficient prior knowledge, the source credentials positively influenced the information’s credibility. Negative comments from personal networks decreased perceived credibility significantly, and this effect was slightly more pronounced when the comments came from close friends. For credible information, a large number of reposts added to the credibility, whereas for less credible information, a large number of reposts may induce greater skepticism and decrease perceived credibility.

Introduction

Over the last five years, microblog sites, such as Twitter, have become a major information source for their users all over the world. In China, microblog sites appear to act as an even more important information source. According to a report from the Chinese Academy of Sciences in 2012 (Yin, Wu, & Liu, 2012), 70% of microblog users in China considered microblog sites as their primary source of news. This percentage was considerably higher than what the Pew Center reported about US users in 2012, with only 9% of Americans getting their news from social networking sites, including Twitter (Pew Research Center’s Journalism Project, 2012). A recent comparative study showed that Chinese microblog users consider microblogs as not only a more important and but also a more credible information source than US microblog users do (Yang, Counts, Morris, & Hoff, 2013). Among young students in China, microblog sites are considered the most credible information source (Shan, 2013). The real credibility of information circulated on microblog sites, however, is highly questionable. According to the 2013 report on the development of new media in China (Tang, Wu, Huang, & Liu, 2013), more than one-third of the rumors spread online were generated from microblogs. This poor credibility of information on microblog sites can be attributed to the ease of spreading incorrect information and the lack of professional gatekeepers and other measures to ensure the quality of information (Castillo et al., 2011, Haas and Wearden, 2003, Metzger, 2007, Sundar, 2008).

Misleading information on microblog sites may lead to serious consequences when people use such information for making critical decisions, especially when the information is related to health and safety (Castillo et al., 2011, Mendoza et al., 2010, Schwarz and Morris, 2011). It may lead to improper treatment of health problems and negative impact to personal wellbeing. In addition, due to the social amplification effect (Kasperson et al., 1988), erroneous information involving health and safety risks may produce a massive public reaction. A typical example was the salt panic in China in March 2011 after the Fukushima nuclear radiation crisis.1 A rumor on Weibo, the most influential microblog site in China, saying that the iodine contained in salt would help shield people from radioactivity resulted in a nation-wide panic and spurred a rush on salt buying in many cities.2 Furthermore, over time the negative consequences of the inaccurate information may undermine the public’s trust in online health and safety information.

A challenge for assessing information credibility on microblog sites is that users have difficulty in judging who should be responsible for the credibility of a certain message and how credible the person or the source is (Schmierbach and Oeldorf-Hirsch, 2012, Jiang et al., 2012, Jiang et al., 2014). A number of studies reported how users evaluate the credibility of the source with indirect credibility cues, such as the gender, the name style, and the use of avatar image (Morris et al., 2012, Westerman et al., 2012, Yang et al., 2013). However, none of these studies examined the impact of a direct credibility indicator provided by microblog sites—verification credentials for users whose authenticity and qualifications have been proved by the sites—on the perception of credibility of users. In addition, on microblog sites, all posts have a similar look and feel. Thus microblog users are more likely to look at what is written in the message instead of how professional the appearance and layout is for evaluating the credibility. So far there has been no research on how the composition of messages would influence the credibility perception of microblog users. Existing research on message compositions focuses on advertising information in print media. Moreover, being connected with peers, microblog users can rely on various social cues for judging credibility. Some recent studies have investigated social cues related to the source, such as the number of followers/follows of the source account (Metzger et al., 2010, Westerman et al., 2012), but no research investigates the impact of social cues related to information distribution in microblog networks on credibility perception. Furthermore, the majority of the current literature on credibility, with a few exceptions, focuses on Western users with English content (AlMansour, Brankovic, & Iliopoulos, 2014). By its definition, credibility perception is subjective and influenced by one’s cultural background. Significant differences exist between Western culture and China (Hofstede et al., 2010, Nisbett et al., 2001). Given that Chinese users are the largest user group of microblogging services, we believe that an investigation into microblog credibility issues for Chinese users is needed.

This study aims to deepen our understanding of how Chinese users judge the credibility of health and safety information on microblog sites by addressing the gaps discussed above. We examined cues related to information sources (source credentials), message composition (claim extremity, claim type), and information distribution in networks (being reposted by friends vs. celebrities, negative vs. positive comments, the number of posts). We proposed research questions by reviewing previous literature and analyzing the characteristics of microblog sites. Then we conducted three experiments in which participants viewed posts related to health and safety from a mocked up Weibo site and rated how credible the information was. Implications of the findings were discussed later.

Section snippets

Source credentials

Source credentials refer to certificates proving the authenticity and qualifications of information sources. On microblog sites such credentials are often in the form of verification badges. For examples, on Weibo, individual users who have more than 100 followers, use their real name and photo for the Weibo profile, and are willing to provide their real personal information to the website’s administrator (e.g., a scanned copy of an identity card) can apply for a verification credential. After

Overview of experiments

Fig. 1 shows the research framework for this study. We conducted three experiments to answer the research questions. The experimental approach was chosen because it is important to observe how people judge information credibility. Whereas people claimed that certain elements, such as the identity of site sponsor and privacy policy, are vital to a website’s credibility in a national survey study (Princeton Survey Research Associates., 2012), a later experimental study found that people judge a

Involvement with the topics

As shown in Table 3, participants had a high level of involvement with the four types of health and safety information, in contrast to a low level of involvement with advertisement information. A significant difference was found in the level of involvement with different information topics (F (4, 316) = 124.54, p < .001). Post hoc analysis showed that participants’ involvement with advertise messages (M = 2.56, SD = 1.21) was significantly lower than with health and safety messages (p < .001 for all

The impact of claim type, claim extremity, and source credentials

The effects of claim extremity, claim type, and source credentials were not significant for the advertisement information, whereas these factors have been reported effective credibility cues in previous research. One possible explanation for this result is that the Internet users are even more skeptical to commercial information than traditional mass media users (Metzger et al., 2010). In fact, the credibility of advertisement information was significantly lower than health and safety

Contributions of the current study

First, this study contributes to a growing body of literature about credibility perception on social media with a distinct focus on health and safety information. In the past few years, health and safety topics have been highly popular on Chinese microblog sites. Li et al. (2013) analyzed 6025 posts that had being reposted more than 1000 times on Weibo and found that 7.44% of them were exclusively about health. In addition, 21.9% of these popular posts talked about hot social events, including

Acknowledgement

This study was supported by the National Natural Science Foundation of China (Project no. 71401087).

References (58)

  • A.A. AlMansour et al.

    A model for recalibrating credibility in different contexts and languages – A twitter case study

    International Journal of Digital Information and Wireless Communication

    (2014)
  • E.W. Austin et al.

    Source v. Content effects on judgments of news believability

    Journalism and Mass Communication Quarterly

    (1994)
  • Castillo, C., Mendoza, M., & Poblete, B. (2011). Information credibility on twitter. In WWW ‘11: Proceedings of the...
  • D. Cohen

    Surrogate indicators and deception in advertising

    Journal of Marketing

    (1972)
  • G. Cvetkovich et al.

    New information and social trust: Asymmetry and perseverance of attributions about hazard managers

    Risk Analysis

    (2002)
  • W.K. Darley et al.

    Advertising claim objectivity: Antecedents and effects

    Journal of Marketing

    (1993)
  • Edelman, R. (2009). Edelman trust barometer 2009. Technical report, Edelman, January 2008. Retrieved from Google...
  • C. Edwards et al.

    How much Klout do you have…a test of system generated cues on source credibility

    Computers in Human Behavior

    (2013)
  • G. Eysenbach et al.

    How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews

    BMJ (Clinical Research Ed.)

    (2002)
  • A.J. Flanagin et al.

    Perceptions of internet information credibility

    Journalism and Mass Communication Quarterly

    (2000)
  • A.J. Flanagin et al.

    Trusting expert- versus user-generated ratings online: The role of information volume, valence, and consumer characteristics

    Computers in Human Behavior

    (2013)
  • Fogg, B. J., Soohoo, C., Danielson, D. R., Marable, L., Stanford, J., & Tauber, E. R. (2003). How do users evaluate the...
  • G.T. Ford et al.

    Consumer skepticism of advertising claims: Testing hypotheses from economics of information

    Journal of Consumer Research

    (1990)
  • M.E. Goldberg et al.

    The effects of advertiser reputation and extremity of advertising claim on advertising effectiveness

    Journal of Consumer Research

    (1990)
  • G. Guido

    The salience of marketing stimuli: An incongruity-salience hypothesis on consumer awareness

    (2001)
  • C. Haas et al.

    E-credibility: Building common ground in web environments

    L1-Educational Studies in Language and Literature

    (2003)
  • G.H. Hofstede et al.

    Cultures and organizations: Software of the mind: Intercultural cooperation and its importance for survival

    (2010)
  • Jiang, J. H., Goonawardene, N., & Tan, S. S. (2014). Do you find health advice on microblogging platforms credible?...
  • Jiang, J. H., Tong, Y., & Tan, S. S. (2012). Do you retweet health advice on microblogging platforms? The effects of...
  • R.E. Kasperson et al.

    The social amplification of risk: A conceptual framework

    Risk Analysis

    (1988)
  • G. Koren et al.

    Bias against negative studies in newspaper reports of medical research

    JAMA

    (1991)
  • H.C. Kraemer et al.

    How many subjects?: Statistical power analysis in research

    (1987)
  • J. Lee et al.

    The effect of negative online consumer reviews on product attitude: An information processing view

    Electronic Commerce Research and Applications

    (2008)
  • Li, Y., Gao, H., Yang, M., Guan, W., Ma, H., Qian, W., & Yang, X. (2013). What are Chinese talking about in hot Weibos....
  • C. Luo et al.

    The effects of individualism–collectivism cultural orientation on Ewom information

    International Journal of Information Management

    (2014)
  • Mendoza, M., Poblete, B., & Castillo, C. (2010). Twitter under crisis: Can we trust what we rt? In SOMA ‘10:...
  • M.J. Metzger

    Making sense of credibility on the web: Models for evaluating online information and recommendations for future research

    Journal of the American Society for Information Science and Technology

    (2007)
  • M.J. Metzger et al.

    Social and heuristic approaches to credibility evaluation online

    Journal of Communication

    (2010)
  • Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J. (2012). Tweeting is believing?: Understanding microblog...
  • Cited by (58)

    • Spatial characteristics and influencing factors of risk perception of haze in China: The case study of publishing online comments about haze news on Sina

      2021, Science of the Total Environment
      Citation Excerpt :

      Therefore, in this study, we select the top ten news each year as the research object according to the haze theme and the number of comments. The source of information has a positive impact on the credibility of information (Gao et al., 2015). Many scholars often use the network news and comments of main media as data sources (Henrich and Holmes, 2011).

    • Factors influencing bid-winning performance in mixed crowdsourcing: The persuasive effect of credible information sources

      2021, Technology in Society
      Citation Excerpt :

      Thus, contact validation guarantees the contractor's authenticity to a certain extent, reduces the uncertainty of the contractees' choices, and enhances contractees' perception of the integrity of contractors. Gao et al. [48] reveal that real-name authentication usually improves the credibility of the Weibo posts of users. Therefore, contact authentication positively influences the likelihood of the contractor winning the bid.

    • Who inadvertently shares deepfakes? Analyzing the role of political interest, cognitive ability, and social network size

      2021, Telematics and Informatics
      Citation Excerpt :

      More extensive social networks increase the likelihood of social endorsements and repetition of information. When users have limited prior knowledge of a subject, they often rely on social cues within social media for information credibility (Gao et al., 2015). As such, citizens with low levels of political interest may depend on the social cues of others to judge political content.

    • How Users' Gaze Behavior Is Related to Their Quality Evaluation of a Health Website Based on HONcode Principles?

      2021, Data and Information Management
      Citation Excerpt :

      In reviewing researches about the evaluation principles of health websites, information content principles such as accuracy, completeness, and readability of health information have been influenced by the features of disease information, treatment methods, medication instructions, and information sources in a great deal of previous research (Kräenbring et al., 2014; CandelarioVazquez, Jackson, & Reilly, 2017; Phillips, Lam, & Palmisano, 2014; Stinson et al., 2011). Researchers have attempted to explore the perceived information credibility from the features of health information contents, sources, qualifications of doctors or authors, websites contact information, and site sponsors (Avery, 2010; Freeman & Spyridakis, 2009; Liao & Fu, 2014; Gao, Tian, & Tu, 2015). Availability of hyperlinks and websites contact information is used to evaluate the accessibility of health information in several studies (Skovrlj, Silvestre, Ibeh, Abbatematteo, & Mocco, 2015; Scott & Errett, 2018).

    • Palm oil and its environmental impacts: A big data analytics study

      2020, Journal of Cleaner Production
      Citation Excerpt :

      Ultimately, viral information can be spread rapidly in the social media context. These online opinions/comments as a form of electronic word-of-mouth (eWOM) have been extensively explored in terms of comments characteristics (Teng et al., 2014) and the impacts on consumer attitude and behavioral changes (Gao et al., 2015; Teng et al., 2014). Building on social movements and social movement channels, we explore the role of social media in influencing corporate environmental management.

    • Promoting users’ intention to share online health articles on social media: The role of confirmation bias

      2020, Information Processing and Management
      Citation Excerpt :

      Recognized as reputable and trustworthy health information providers, healthcare professionals are able to post self-authored health articles via social media such as Weibo and WeChat. Capitalizing on their registered accounts of these platforms, users can forward such health information (Gao, Tian, & Tu, 2015). Moreover, these writers are also encouraged to publish health articles on some professional websites, including Ding Xiang Yuan (www.dxy.cn), Guoke (www.guokr.com), and Zhihu (www.zhihu.com).

    View all citing articles on Scopus
    View full text