Abstract
This paper studies Community-driven Question-Answering (CQA) websites from the perspective of three dimensions, namely, information management, information quality, and system usability. The objective of this paper is two-fold. First, it aims to develop a conceptual framework that encapsulates the three aspects. Second, using this framework, it attempts to perform a comparative evaluation of six CQA websites (three English and three Chinese). Information management is conceptualized by information sharing and information organization in websites while information quality consists of content value, cognitive value and socio-emotional value of information contained in the answers. System usability of websites is measured through Nielsen’s ten heuristic guidelines. Based on the results, three findings could be culled. First, information organization was more prevalent among the websites than information sharing. Second, socio-emotional value of information was more evident among the three measures of information quality. Third, all CQA websites indicated scope for improvement in their usability features.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Surowiecki, J.: The wisdom of crowds. Anchor Books, New York (2004)
Kim, S., Oh, S.: Users’ Relevance Criteria for Evaluating Answers in a Social Q&A Site. Journal of the American Society for Information Science and Technology 60(4), 716–727 (2009)
U.S. visits to question and answer websites increased 118 percent year-over-year, http://www.hitwise.com/presscenter/hitwiseHS2004/question-and-answer-websites.php
Detlor, B.: Information management. International Journal of Information Management 30, 103–108 (2010)
Chua, A.Y.K., Goh, D.H.L.: A study of Web 2.0 applications in library websites. Library & Information Science Research 32, 203–211 (2010)
Adamic, L.A., Zhang, J., Bakshy, E., Ackerman, M.S.: Knowledge sharing and Yahoo Answers: everyone knows something. Paper Presented at the Proceedings of the 17th International Conference on World Wide Web, Beijing, China, pp. 665–674 (2008)
Agichtein, E., Castillo, C., Donato, D., Gionis, A., Mishne, G.: Finding high-quality content in social media. Paper Presented at The Proceedings of the International Conference on Web Search and Web Data Mining, California, United States, pp. 183–194 (2008)
Nielsen, J.: Designing web usability: The practice of simplicity. New Riders Publishing, Indianapolis (1999)
Rosenfeld, L., Morville, P.: Information architecture for the World Wide Web, 2nd edn. O’Reilly & Associates, CA (2002)
Gazan, R.: Social Q & A. Journal of the American Society for Information Science and Technology 62(12), 2301–2312 (2011)
Fichman, P.: A comparative assessment of answer quality on four question answering sites. Journal of Information Science 37(5), 476–486 (2011)
Rousch, W.: What’s the Best Q & A Site? Technology Review (December 3, 2006)
Conde, T., Marcelino, L., Fonseca, B.: Implementing a System for Collaborative Search of Local Service. In: Briggs, R.O., Antunes, P., Vreede, G.J., Read, A.S. (eds.) Groupware: Design, Implementation, and Use, Omaha, NE, USA, pp. 17–24 (2008)
Blooma, J.M., Chua, A.Y.K., Goh, D.H.L.: What Makes a High-Quality User-Generated Answer? IEEE Internet Computing 15(1), 66–71 (2011)
Kahn, B.K., Strong, D.M., Wang, R.Y.: Information quality benchmarks: Product and service performance. Communications of the ACM 45(4), 184–192 (2002)
Kelly, D., Wacholder, N., Rittman, R., Sun, Y., Kantor, P., Small, S., Strzalkowski, T.: Using Interview Data to Identify Evaluation Criteria for Interactive, Analytical Question-Answering Systems. Journal of the American Society for Information Science And Technology 58(7), 1032–1043 (2007)
Preece, J.: Online Communities: Designing Usability and Supporting Sociability. John Wiley & Sons, Chichester (2000)
Phang, C.W., Kankanhalli, A., Sabherwal, R.: Usability and Sociability in Electronic Communities: A Comparative Study of Knowledge Seekers and Contributors. Journal of AIS 10(10), 721–747 (2009)
Nielsen, J.: Finding usability problems through heuristic evaluation. Paper Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM (1992)
Internet World Stats - Internet world users by language (2012), http://www.internetworldstats.com/stats7.html
Lin, J., Katz, B.: Building a Reusable Test Collection for Question Answering. Journal of the American Society for Information Science and Technology 57(7), 851–861 (2006)
Voorhees, E.M.: Overview of the TREC 2004 question answering track. Paper Presented at the Proceedings of the 13th Text Retrieval Conference, pp. 52–62 (2005)
Cohen, J.: A coeffiecient of agreement for nominal scales. Educational and Psychological Measurement 20(1), 37–46 (1960)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chua, A.Y.K., Balkunje, R.S. (2012). Comparative Evaluation of Community Question Answering Websites. In: Chen, HH., Chowdhury, G. (eds) The Outreach of Digital Libraries: A Globalized Resource Network. ICADL 2012. Lecture Notes in Computer Science, vol 7634. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34752-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-34752-8_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34751-1
Online ISBN: 978-3-642-34752-8
eBook Packages: Computer ScienceComputer Science (R0)