Abstract
Question Answering platforms are becoming an important repository of crowd-generated knowledge. In these systems a relatively small subset of users is responsible for the majority of the contributions, and ultimately, for the success of the Q/A system itself. However, due to built-in incentivization mechanisms, standard expert identification methods often misclassify very active users for knowledgable ones, and misjudge activeness for expertise. This paper contributes a novel metric for expert identification, which provides a better characterisation of users’ expertise by focusing on the quality of their contributions. We identify two classes of relevant users, namely sparrows and owls, and we describe several behavioural properties in the context of the StackOverflow Q/A system. Our results contribute new insights to the study of expert behaviour in Q/A platforms, that are relevant to a variety of contexts and applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, A., Huttenlocher, D., Kleinberg, J., Leskovec, J.: Kleinberg J., and Leskovec J.: Steering user behavior with badges. In: WWW 2013, pp. 95–106. ACM (2013)
Bian, J., Liu, Y., Zhou, D., Agichtein, E., Zha, H.: Learning to recognize reliable users and content in social media with coupled mutual reinforcement. In: WWW 2009, pp. 51–60. ACM (2009)
Bouguessa, M., Dumoulin, B., Wang, S.: Identifying authoritative actors in question-answering forums: The case of yahoo! answers. In: KDD 2008, pp. 866–874. ACM (2008)
Ericsson, K.A.: The Cambridge handbook of expertise and expert performance. Cambridge University Press (2006)
Fritz, T., Ou, J., Murphy, G.C., Murphy-Hill, E.: A degree-of-knowledge model to capture source code familiarity. In: ICSE 2010, pp. 385–394. ACM (2010)
Hanrahan, B.V., Convertino, G., Nelson, L.: Modeling problem difficulty and expertise in stackoverflow. In: CSCW 2012, pp. 91–94. ACM (2012)
Jurczyk, P., Agichtein, E.: Discovering authorities in question answer communities by using link analysis. In: CIKM 2007, pp. 919–922. ACM (2007)
Kagdi, H., Hammad, M., Maletic, J.I.: Who can help me with this source code change? In: ICSM 2008, pp. 157–166. IEEE (2008)
Ma, D., Schuler, D., Zimmermann, T., Sillito, J.: Expert recommendation with usage expertise. In: ICSM 2009, pp. 535–538. IEEE (2009)
Pal, A., Chang, S., Konstan, J.A.: Evolution of experts in question answering communities. In: ICWSM 2012. AAAI (2012)
Pal, A., Harper, F.M., Konstan, J.A.: Exploring question selection bias to identify experts and potential experts in community question answering. ACM Trans. Inf. Syst. 30(2), 10 (2012)
Pal, A., Konstan, J.A.: Expert identification in community question answering: exploring question selection bias. In: CIKM 2010, pp. 1505–1508. ACM (2010)
Vasilescu, B., Serebrenik, A., Devanbu, P., Filkov, V.: How social q&a sites are changing knowledge sharing in open source software communities. In: CSCW 2014, ACM (2014)
Zhang, J., Ackerman, M.S., Adamic, L.: Expertise networks in online communities: structure and algorithms. In: WWW 2007, pp. 221–230. ACM (2007)
Zhou, Y., Cong, G., Cui, B., Jensen, C.S., Yao, J.: Routing questions to the right users in online communities. In: ICDE 2009, pp. 700–711. IEEE (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, J., Tao, K., Bozzon, A., Houben, GJ. (2014). Sparrows and Owls: Characterisation of Expert Behaviour in StackOverflow. In: Dimitrova, V., Kuflik, T., Chin, D., Ricci, F., Dolog, P., Houben, GJ. (eds) User Modeling, Adaptation, and Personalization. UMAP 2014. Lecture Notes in Computer Science, vol 8538. Springer, Cham. https://doi.org/10.1007/978-3-319-08786-3_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-08786-3_23
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08785-6
Online ISBN: 978-3-319-08786-3
eBook Packages: Computer ScienceComputer Science (R0)