skip to main content
research-article

Recognizing Experts on Social Media: A Heuristics-Based Approach

Published:30 July 2019Publication History
Skip Abstract Section

Abstract

Knowing who is an expert on social media is a challenging yet important task, especially in a world where misleading information is commonplace and where social media is an important information source for knowledge seekers. In this paper we investigate expertise heuristics by comparing features of experts versus non-experts in big data settings. We employ a large set of features to classify experts and non-experts using data collected on two social media platform (Twitter and reddit). Our results show a good ability to predict who is an expert, especially using language-based features, validating that heuristics can be developed to differentiate experts from novices organically, based on social media use. Our results contribute to the development of expertise location and identification systems as well as our understanding on how experts present themselves on social media.

References

  1. Adamic, L. A., Zhang, J., Bakshy, E., & Ackerman, M. S. (2008). Knowledge sharing and Yahoo answers: Everyone knows something. In Proceedings of the 17th International Conference on World Wide Web, 665--674. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Agichtein, E., Castillo, C., Donato, D., Gionis, A., & Mishne, G. (2008). Finding high-quality content in social media. In Proceedings of the 2008 international conference on web search and data mining, 183--194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Alavi, M., & Leidner, D. E. (2001). Knowledge management and knowledge management systems: Conceptual foundations and research issues. MIS Quarterly, 107--136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Bakshy, E., Hofman, J. M., Mason, W. A., & Watts, D. J. (2011). Everyone's an influencer: Quantifying influence on Twitter. In Proceedings of the fourth ACM international conference on Web search and data mining, 65--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Balog, K., de Rijke, M., & Weerkamp, W. (2008). Bloggers as experts: Feed distillation using expert retrieval models. In Proceedings of SIGIR, 753--754. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Balthazard, P., Potter, R. E., & Warren, J. (2004). Expertise, extraversion and group interaction styles as performance indicators in virtual teams: how do perceptions of IT's performance get formed? ACM SIGMIS Database: The DATABASE for Advances in Information Systems, 35(1), 41--64.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Becerra-Fernandez, I. (2006). Searching for experts on the Web: A review of contemporary expertise locator systems. ACM Transactions on Internet Technology (TOIT), 6(4), 333--355.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Buitinck L., Louppe G., Blondel M., Pedregosa F., Mueller A., Grisel O., Niculae V., Prettenhofer P., Gramfort A., Grobler J., Layton R., VanderPlas J., Joly A., Holt B., & Varoquaux G. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12(Oct), 2825--2830. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Chai, K., Potdar, V., & Dillon, T. (2009). Content quality assessment related frameworks for social media. Computational Science and Its Applications--ICCSA 2009, 791--805. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Journal of the American Society for Information Science, 50(2).Google ScholarGoogle Scholar
  11. Ehrlich, K., Lin, C. Y., & Griffiths-Fisher, V. (2007). Searching for experts in the enterprise: Combining text and social network analysis. In Proceedings of the 2007 International ACM Conference on Supporting Group Work, 117--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Faraj, S., & Sproull, L. (2000). Coordinating expertise in software development teams. Management Science, 46(12), 1554--1568.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016). The rise of social bots. Communications of the ACM, 59(7), 96--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Géron A. (2017). Hands on Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O'Reilly Media. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Guillaume L., Nogueira F., & Aridas C. (2017) Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. Journal of Machine Learning Research, 1--5.Google ScholarGoogle Scholar
  16. Guy, I., Avraham, U., Carmel, D., Ur, S., Jacovi, M., & Ronen, I. (2013). Mining expertise and interests from social media. In Proceedings of WWW, 515--526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Hessel, J., Tan, C., & Lee, L. (2016, December). Science, AskScience, and BadScience: On the Coexistence of Highly Related Communities. In ICWSM, 171--180.Google ScholarGoogle Scholar
  18. Higgins, M. (1999). Meta-information, and time: Factors in human decision making. Journal of the American Society for Information Science, 50(2). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Hirsch, J.E., (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 16569--16572.Google ScholarGoogle ScholarCross RefCross Ref
  20. Horne, B. D., & Adalı, S. (2017). The Impact of Crowds on News Engagement: A Reddit Case Study. In NECO at ICWSM.Google ScholarGoogle Scholar
  21. Horne, B. D., Nevo, D., Freitas, J., Ji, H., & Adalı, S. (2016). Expertise in social networks: How do experts differ from other users? In ICWSM, 583--586.Google ScholarGoogle Scholar
  22. Horne, B. D., Adalı, S., & Sikdar S. (2017). Identifying the social signals that drive online discussions: A case study of Reddit communities. In Proceeding of ICCCN.Google ScholarGoogle Scholar
  23. Hovland, C., Janis, I., & Kelly, H. (1953). Communication and persuasion; Psychological studies of opinion change. New Haven: Yale University Press.Google ScholarGoogle Scholar
  24. Jaech, A., Zayats, V., Fang, H., Ostendorf, M. & Hajishirzi, H. (2015). Talking to the crowd: What do people react to in online discussions?. arXiv preprint arXiv:1507.02205.Google ScholarGoogle Scholar
  25. Jurczyk, P., & Agichtein, E. (2007). Discovering authorities in question answer communities by using link analysis. In Proceedings of the Sixteenth ACM Conference on Conference on Information and Knowledge Management, 919--922. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Kardan, A., Garakani, M., & Bahrani, B. (2010). A method to automatically construct a user knowledge model in a forum environment. In Proceedings of SIGIR, 717--718. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Kintab, G. A., Roy, C. K., & McCalla, G. I. (2014). Recommending software experts using code similarity and social heuristics. In Proceedings of 24th Annual International Conference on Computer Science and Software Engineering, 4--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Korfiatis, N., GarcíA-Bariocanal, E., & Sánchez-Alonso, S. (2012). Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content. Electronic Commerce Research and Applications, 11(3), 205--217. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kumar, S., Cheng, J., Leskovec, J., & Subrahmanian, V. S. (2017). An army of me: Sockpuppets in online discussion communities. In Proceedings of the 26th International Conference on World Wide Web, 857--866. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Li, C. T., & Shan, M. K. (2013). X2- search: Contextual expert search in social networks. In Proceedings of Conference on Technologies and Applications of Artificial Intelligence (TAAI), 176--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. McPherson, M., Smith-Lovin, L. & Cook, J.M. (2001). Birds of a feather: Homophily in social networks. Annual review of sociology, 27(1), 415--444.Google ScholarGoogle Scholar
  32. Mun, Y. Y., Yoon, J. J., Davis, J. M., & Lee, T. (2013). Untangling the antecedents of initial trust in Web-based health information: The roles of argument quality, source expertise, and user perceptions of information quality and risk. Decision Support Systems, 55(1), 284--295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Nevo, D., & Wand, Y. (2005). Organizational memory information systems: A transactive memory approach. Decision Support Systems, 39(4), 549--562.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Nevo, D., Benbasat, I., & Wand, Y. (2012). Understanding technology support for organizational transactive memory: Requirements, application, and customization. Journal of Management Information Systems 28(4):69--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Page, R. (2012). The linguistics of self-branding and micro-celebrity in Twitter: The role of hashtags. Discourse & Communication, 6(2), 181--201.Google ScholarGoogle ScholarCross RefCross Ref
  36. Pal, A., Farzan, R., Konstan, J., & Kraut, R. (2011). Early detection of potential experts in question answering communities. User Modeling, Adaption and Personalization, 231--242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Pennebaker, J.W., Chung, C.K., Frazee, J., Lavergne, G.M. & Beaver, D.I. (2014). When small words foretell academic success: The case of college admissions essays. PloS one, 9(12), p.e115844.Google ScholarGoogle ScholarCross RefCross Ref
  38. Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion. In In Communication and Persuasion. New York: Springer. 1--24.Google ScholarGoogle ScholarCross RefCross Ref
  39. Reuber, R. (1997). Management experience and management expertise. Decision Support Systems, 21(2), 51--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Riahi, F., Zolaktaf, Z., Shafiei, M., & Milios, E. (2012). Finding expert users in community question answering. In Proceedings of the 21st International Conference on World Wide Web, 791--798. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Shami, N. S., Ehrlich, K., Gay, G., & Hancock, J. T. (2009). Making sense of strangers' expertise from signals in digital artifacts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 69--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Shanteau, J. (1992). The psychology of experts an alternative view. Expertise and decision support, 11--23.Google ScholarGoogle Scholar
  43. Shanteau, J., Weiss, D., Thomas, R., & Pounds, J. (2002). Performance-based assessment of expertise: How to decide if someone is an expert or not. European Journal of Operational Research 136(2):253--263.Google ScholarGoogle ScholarCross RefCross Ref
  44. Sikdar, S., Kang, B., O'Donovan, J., Hollerer, T., & Adalı, S. (2013). Understanding information credibility on Twitter. In Social computing (socialcom), 2013 international conference on, 19--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Starbird, K. (2017). Examining the Alternative Media Ecosystem Through the Production of Alternative Narratives of Mass Shooting Events on Twitter. In ICWSM, 230--239.Google ScholarGoogle Scholar
  46. Stiff, J. (1994). Persuasive communication. New York: The Guilford Press.Google ScholarGoogle Scholar
  47. Stewart, K. A., Baskerville, R., Storey, V. C., Senn, J. A., Raven, A., & Long, C. (2000). Confronting the assumptions underlying the management of knowledge: An agenda for understanding and investigating knowledge management. ACM SIGMIS Database: the DATABASE for Advances in Information Systems, 31(4), 41--53.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Strong, D. M., Lee, Y. W., & Wang, R. Y. (1997). Data quality in context. Communications of the ACM, 40(5), 103--110.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Tan, C., & Lee, L. (2015). All who wander: On the prevalence and characteristics of multi-community engagement. In Proceedings of the 24th International Conference on World Wide Web, 1056--1066. International World Wide Web Conferences Steering Committee. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Tausczik, Y. R., & Pennebaker, J. W. (2012). Participation in an online mathematics community: differentiating motivations to add. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 207--216. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Terveen, L., & Hill, W. (2001). Beyond recommender systems: Helping people help each other. HCI in the New Millennium, 1(2001), 487--509.Google ScholarGoogle Scholar
  52. Terveen, L., & McDonald, D. W. (2005). Social matching: A framework and research agenda. ACM transactions on computer-human interaction (TOCHI), 12(3), 401--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Trammell, K. D., & Keshelashvili, A. (2005). Examining the new influencers: A self-presentation study of A-list blogs. Journalism & Mass Communication Quarterly, 82(4), 968--982.Google ScholarGoogle ScholarCross RefCross Ref
  54. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, New Series 185(4157):1124--1131.Google ScholarGoogle Scholar
  55. Unkelbach, C. (2007) Reversing the truth effect: Learning the interpretation of processing fluency in judgements of truth. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 219--230.Google ScholarGoogle ScholarCross RefCross Ref
  56. Varshney, K. R., Chenthamarakshan, V., Fancher, S. W., Wang, J., Fang, D., & Mojsilovi?, A. (2014). Predicting employee expertise for talent management in the enterprise. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 1729--1738. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Wang, R. Y., & Strong, D. M. (1996). Beyond accuracy: What data quality means to data consumers. Journal of Management Information Systems, 12(4), 5--33.? Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Wang, G. A., Jiao, J., Abrahams, A. S., Fan, W., & Zhang, Z. (2013). ExpertRank: A topic-aware expert finding algorithm for online knowledge communities. Decision Support Systems, 54(3), 1442--1451. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Williams, C., & D'Mello, S. (2010). Predicting student knowledge level from domain-independent function and content words. In Intelligent tutoring systems, 62--71. Springer Berlin/Heidelberg. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Wu, S., Hofman, J. M., Mason, W. A., & Watts, D. J. (2011, March). Who says what to whom on twitter. In Proceedings of the 20th international conference on World wide web, 705--714. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Yimam-Seid, D., & Kobsa, A. (2003). Expert-finding systems for organizations: Problem and domain analysis and the DEMOIR approach. Journal of Organizational Computing and Electronic Commerce, 13(1), 1--24.Google ScholarGoogle ScholarCross RefCross Ref
  62. Yogev, A., Guy, I., Ronen, I., Zwerdling, N., & Barnea, M. (2015). Social media-based expertise evidence. In Boulus-Rdje, N., Ellingsen, G., Bratteteig, T., Aanestad, M., & Bjrn, P., eds., ECSCW 2015: Proceedings of the 14th European Conference on Computer Supported Cooperative Work, 19--23 September 2015, Oslo, Norway. Springer International Publishing. 63--82.Google ScholarGoogle Scholar
  63. Zhang, J., & Ackerman, M. S. (2005). Searching for expertise in social networks: a simulation of potential strategies. In Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work, 71--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Zhang, J., Ackerman, M., & Adamic, L. (2007). Expertise networks in online communities: structure and algorithms. In Proceedings of WWW, 221--230. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Recognizing Experts on Social Media: A Heuristics-Based Approach

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader