Abstract
Authority generally relates to expertise, recognition of official status of a source, and the reputation of the author and publisher. As the Internet has become a ubiquitous tool in modern science and scholarly research, evaluating the authority of free online scholarly information is becoming crucial. However, few empirical studies have focused on this issue. Using a modified version of Jim Kapoun’s “Five criteria for evaluating web pages” as framework, this research selected 32 keywords from eight disciplines, inputted them into three search engines (Google, Yahoo and AltaVista) and used Analytic Hierarchy Process to determine the weights. The first batches of results (web pages) from keyword searching were selected as evaluation samples (in the two search phases, the first 50 and 10 results were chosen, respectively), and a total of 3,134 samples were evaluated for authority based on the evaluation framework. The results show that the average authority value for free online scholarly information is about 3.63 (out of five), which is in the “fair” level (3 ≤ Z < 4) (Z is the value assigned to each sample). About 41% of all samples collected provide more authoritative scholarly information. Different domain names, resource types, and disciplines of free online scholarly information perform differently when scored in terms of authority. In conclusion, the authority of free online scholarly information has been unsatisfactory, and needs to be improved. Furthermore, the evaluation framework and its application developed herein could be a useful instrument for librarians, researchers, students, and the public to select Internet resources.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexander, J. E., & Tate, M. A. (1999). Web wisdom: How to evaluate and create information quality on the web. Mahwah: Lawrence Erlbaum Associates.
Barnes, S., & Vidgen, R. (2002). An integrative approach to the assessment of e-commerce quality. Journal of Electronic Commerce Research, 3(3), 114–127.
Barnes, M. D., Penrod, C., Neiger, B. L., Merrill, R. M., Thackeray, R., Eggett, D. L., et al. (2003). Measuring the relevance of evaluation criteria among health information seekers on the Internet. Journal of Health Psychology, 8(1), 71–82.
Bernstam, E. V., Shelton, D. M., Walji, M., & Bernstam, F. M. (2005). Instruments to assess the quality of health information on the World Wide Web: What can our patients actually use? International Journal of Medical Informatics, 74, 13–19.
Bopp, R. E., & Smith, L. C. (2000). Reference and information services: An introduction. Westport: Greenwood Publishing Corp.
China Internet Network Information Center. (2011, January). The statistics of China internet information development. Accessed February 15, 2011, from http://www.cnnic.cn/research/bgxz/tjbg/201101/P020110221534255749405.pdf.
Collins, B. R. (1996). Webwatch. Library Journal, 1 February, 32–33.
Cornell University Library. (2010). Five criteria for evaluating web pages. Accessed October 21, 2010, from http://olinuris.library.cornell.edu/ref/research/webcrit.html.
Commission of the European Communities. (2002). eEurope 2002: Quality criteria for health related websites. Journal of Medical Internet Research 4(3), e15. Accessed October 21, 2010, from http://www.jmir.org/2002/3/e15/.
Dong, X. Y. (2003). Searching information and evaluation of Internet: A Chinese academic library users. International Information & Library Review, 35(2/4), 163–187.
Fox, S. (2006). Online health search 2006. Pew internet & American life project. Accessed October 15, 2007, from http://www.pewinternet.org/~/media//Files/Reports/2006/PIP_Online_Health_2006.pdf.pdf.
Fritch, J. W., & Cromwell, R. L. (2001). Evaluating internet resources: Identity, affiliation, and cognitive authority in a networked world. Journal of the American Society for Information Science and Technology, 52(6), 499–507.
Hairston, M., & Ruszkiewicz, J. J. (1996). The Scott Foresman handbook for writers (4th ed.). New York: HarperCollins.
Hargrave, D. R., Hargrave, U. A., & Bouffet, E. (2006). Quality of health information on the internet in pediatric neuro-oncology. Neuro-Oncology, 8(2), 175–182.
HealthInsite Editorial Team, National Health Call Centre Network. Publishing standards for healthinsite. Version 6, 2010. Accessed November 3, 2010, from http://www.healthinsite.gov.au/UserFiles/File/HealthInsite_publishing_standards_v6_June_2010_PDF.pdf.
Horrigan, J., & Rainie, L. (2006). The Internet’s growing role in life’s major moments. Pew internet & American life project. Accessed February 25, 2007, from http://www.pewinternet.org/PPF/r/181/report_display.asp.
Kapoun, J. (1998). Teaching undergrads web evaluation: A guide for library instruction. C&RL News, July/August, 522–523.
Katz, W. A. (1980). Collection development: The selection of materials for libraries. New York: Holt, Rinehart, and Winston.
Kim, P., Eng, T. R., Deering, M. J., & Maxfield, A. (1999). Published criteria for evaluating health related web sites: Review. BMJ, 318(7184), 647–649.
Liu, Z. M., & Huang, X. B. (2005). Evaluating the credibility of scholarly information on the web: A cross cultural study. The International Information & Library Review, 37(2), 99–106.
McGeachin, R. (1998). Selection criteria for web-based resources in a science and technology library collection. Accessed January 21, 2007, from http://www.library.ucsb.edu/istl/98-spring/article2.html.
Miller, H. (1996). The multiple dimensions of information quality. Information Systems Management, 13(2), 79–83.
New Mexio State University Library (2009). Evaluation criteria. Accessed October 21, 2010, from http://lib.nmsu.edu/instruction/evalcrit.html.
Nicholas, D., Huntington, P., Williams, P., & Gunter, B. (2003). Perceptions of the authority of health information. Case study: Digital interactive television and the internet. Health Information and Libraries Journal, 20(4), 215–224.
Norman, C. C., & Wittenberg, K. (2003). The electronic publishing initiative at Columbia (EPIC) and the use and costs evaluation program. New Review of Information Networking, 9(1), 66–78.
Pitschmann, L. A. (2001). Building sustainable collections of free third-party Web resources. Washington: Digital Library Federation, Council on Library and Information Resources.
Provost, M., Koompalum, D., Dong, D., & Martin, B. C. (2006). The initial development of the WebMedQual scale: Domain assessment of the construct of quality of health web sites. International Journal of Medical Informatics, 75(1), 42–57.
Rieh, S. Y. (2002). Judgment of information quality and cognitive authority in the Web. Journal of the American Society for Information Science and Technology, 53(2), 145–161.
Rieh, S. Y., & Belkin, N. J. (1998). Understanding judgment of information quality and cognitive authority in the WWW. In C. M. Preston (Ed.), Proceedings of the 61st ASIS annual meeting (pp. 279–289). Silver Spring, MD: American Society for Information Science.
Sacchetti, P., Zvara, P., & Plante, M. K. (1999). The internet and patient education resources and their reliability: Focus on a select urologic topic. Urology, 53(6), 1117–1120.
Sellitto, C., & Burgess, S. (2005). Towards a weighted average framework for evaluating the quality of web-located health information. Journal of Information Science, 31(4), 260–272.
Sheridan libraries of Johns Hopkins University. (1996). Evaluating information found on the internet. Accessed June 11, 2007, from http://www.library.jhu.edu/researchhelp/general/evaluating/.
Smith, A. G. (1997). Testing the surf: Criteria for evaluating Internet information resources. The public-access computer systems review, 8(3). Accessed January 21, 2007, from http://epress.lib.uh.edu/pr/v8/n3/smit8n3.html.
Tenopir C. (2003). Use and users of electronic library resources: An overview and analysis of recent research studies. Accessed February 25, 2007, from http://www.clir.org/pubs/reports/pub120/pub120.pdf.
Tillman H. (2003). Evaluating quality on the Net. Accessed January 21, 2007, from http://www.hopetillman.com/findqual.html.
Tseng, S., & Fogg, B. J. (1999). Credibility and computing technology. Communications of the ACM, 42(5), 39–44.
University of Alberta Libraries (2009). Critical evaluation of internet resources. Accessed October 21, 2010, from http://guides.library.ualberta.ca/eval_internet.
University of Southern Maine Library. (2004). Checklist for evaluating Web resources. Accessed February 25, 2007, from http://library.usm.maine.edu/research/researchguides/webeval.php.
Wang, Y. L. (2007). Automatic detecting indicators for quality of health information on the web. International Journal of Medical Informatics, 76(8), 575–582.
Wang, Y. L., & Liu, Z. K. (2007). Automatic detecting indicators for quality of health information on the web. International Journal of Medical Informatics, 76, 575–582.
Wilson, P. (1983). Second-hand knowledge: An inquiry into cognitive authority. Westport: Greenwood Press.
Yeo, H., Roman, S., Air, M., Maaser, C., Trapasso, T., Kinder, B., et al. (2007). Filling a void: Thyroid cancer surgery information on the internet. World Journal of Surgery, 31(6), 1185–1191.
Acknowledgment
This study is partially supported by Social Science Foundation of China “public sector information exploitation” under the agreement 09 & ZD039. The authors want to thank all the home and international participants of survey for this research.
Author information
Authors and Affiliations
Corresponding author
Appendix 1: Questionnaire for the measurement of criteria weights for assessing the authority of free online scholarly information
Appendix 1: Questionnaire for the measurement of criteria weights for assessing the authority of free online scholarly information
Rights and permissions
About this article
Cite this article
Chen, C., Yu, Y., Tang, Q. et al. Assessing the authority of free online scholarly information. Scientometrics 90, 543–560 (2012). https://doi.org/10.1007/s11192-011-0524-5
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-011-0524-5