skip to main content
10.1145/2851581.2892311acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Among the Machines: Human-Bot Interaction on Social Q&A Websites

Published: 07 May 2016 Publication History

Abstract

With the rise of social media and advancements in AI technology, human-bot interaction will soon be commonplace. In this paper we explore human-bot interaction in STACK OVERFLOW, a question and answer website for developers. For this purpose, we built a bot emulating an ordinary user answering questions concerning the resolution of git error messages. In a first run this bot impersonated a human, while in a second run the same bot revealed its machine identity. Despite being functionally identical, the two bot variants elicited quite different reactions.

References

[1]
Eyal Aharoni and Alan J Fridlund. 2007. Social reactions toward people vs. computers: How mere lables shape interactions. Comput Hum Behav 23, 5 (2007), 2175-2189.
[2]
Miltiadis Allamanis and Charles Sutton. 2013. Why, when, and what: analyzing Stack Overflow questions by topic, type, and code. In Proc. MSR. IEEE, 53-56.
[3]
Jeff Atwood. 2009. Handling Duplicate Questions. http://blog.stackoverflow.com/2009/04/handling-duplicate-questions/. (2009). Published 4/29/2009; Last Accessed 1/6/2016.
[4]
Frank Biocca, Chad Harms, and Judee K Burgoon. 2003. Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence 12, 5 (2003), 456-480.
[5]
Yazan Boshmaf, Ildar Muslukhov, Konstantin Beznosov, and Matei Ripeanu. 2013. Design and analysis of a social botnet. Computer Networks 57, 2 (2013), 556-578.
[6]
Judee K Burgoon. 1993. Interpersonal expectations, expectancy violations, and emotional communication. Journal of Language and Social Psychology 12, 1--2 (1993), 30-48.
[7]
Donn Erwin Byrne. 1971. The attraction paradigm. Vol. 11. Academic Pr.
[8]
Maxime Clément and Matthieu J Guitton. 2015. Interacting with bots online: Users' reactions to actions of automated programs in Wikipedia. Comput Hum Behav 50 (2015), 66-75.
[9]
Stack Exchange Community. 2016. English Language & Usage. http://english.stackexchange.com. (2016). Last Accessed 1/6/2016.
[10]
Stack Overflow Community. 2015a. Question: Can't push rails code to Heroku from Cloud9 because of sqlite. http://stackoverflow.com/a/29898609. (2015). Last Accessed 1/6/2016.
[11]
Stack Overflow Community. 2015b. Question: Setup.py egg_info fails for requirement pygobject when deploying to Heroku. http://stackoverflow.com/a/29447570. (2015). Last Accessed 1/6/2016.
[12]
Chad Edwards, Autumn Edwards, Patric R Spence, and Ashleigh K Shelton. 2014. Is that a bot running the social media feed? Testing the differences in perceptions of communication quality for a human agent and a bot agent on Twitter. Comput Hum Behav 33 (2014), 372-376.
[13]
Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2014. The rise of social bots. arXiv preprint arXiv:1407.5225 (2014).
[14]
Tim Hwang, Ian Pearce, and Max Nanis. 2012. Socialbots: Voices from the Fronts. Interactions 19, 2 (March 2012), 38-45.
[15]
Daan Janssens. 2015. Being the Cleaning Guy. The Tale of a Stack Overflow Janitor Bot. Technical Report. University of Antwerp, Dept. of Mathematics and Computer Science.
[16]
Steve Jones. 2015. How I Learned to Stop Worrying and Love the Bots. Social Media + Society 1, 1 (2015), 2056305115580344.
[17]
Maria Korolov. 2015. Bots now outnumber humans on the web. http://www.csoonline.com/article/2922334/malware-cybercrime/bots-now-outnumber-humans-on-the-web.html. (2015). Published 5/14/2015; Last Accessed 1/6/2016.
[18]
Catherine L Lortie and Matthieu J Guitton. 2011. Social organization in virtual settings depends on proximity to human visual aspect. Comput Hum Behav 27, 3 (2011), 1258-1261.
[19]
Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proc. CHI. ACM, 72-78.
[20]
Roger C Schank and Robert Abelson. 1977. Scripts, goals, plans, and understanding. Hillsdale, NJ: Erlbaum.
[21]
Daniel B Shank. 2013. Are computers good or bad for business? How mediated customer-computer interaction alters emotions, impressions, and patronage toward organizations. Comput Hum Behav 29, 3 (2013), 715-725.
[22]
Patric R Spence, David Westerman, Chad Edwards, and Autumn Edwards. 2014. Welcoming our robot overlords: Initial expectations about interaction with a robot. Communication Research Reports 31, 3 (2014), 272-280.
[23]
Siddharth Subramanian, Laura Inozemtseva, and Reid Holmes. 2014. Live API documentation. In Proc. ICSE. ACM, 643-652.
[24]
Christoph Treude, Martin Robillard, and Barthélémy Dagenais. 2015. Extracting development tasks to navigate software documentation. IEEE TSE 41, 6 (2015), 565-581. 2014.2387172
[25]
Alan M Turing. 1950. Computing machinery and intelligence. Mind LIX, 236 (1950), 433-460.
[26]
Shaowei Wang, David Lo, Bogdan Vasilescu, and Alexander Serebrenik. 2014. EnTagRec: An Enhanced Tag Recommendation System for Software Information Sites. In Proc. ICSME. IEEE, 291-300.
[27]
Joseph Weizenbaum. 1966. ELIZA--a computer program for the study of natural language communication between man and machine. CACM 9, 1 (1966), 36- 45.

Cited By

View all
  • (2024)Semantic Web Approaches in Stack OverflowInternational Journal on Semantic Web & Information Systems10.4018/IJSWIS.35861720:1(1-61)Online publication date: 13-Dec-2024
  • (2024)Beyond the Value for AI Adopters: Analyzing the Impacts of Autonomous Vehicle Testing on Traffic Conditions in CaliforniaSSRN Electronic Journal10.2139/ssrn.4775378Online publication date: 2024
  • (2024)A Disruptive Research Playbook for Studying Disruptive InnovationsACM Transactions on Software Engineering and Methodology10.1145/367817233:8(1-29)Online publication date: 15-Jul-2024
  • Show More Cited By

Index Terms

  1. Among the Machines: Human-Bot Interaction on Social Q&A Websites

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems
    May 2016
    3954 pages
    ISBN:9781450340823
    DOI:10.1145/2851581
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 May 2016

    Check for updates

    Author Tags

    1. social bot
    2. stack overflow
    3. turing test

    Qualifiers

    • Abstract

    Funding Sources

    • Institute for the Promotion of Innovation through Science and Technology in Flanders

    Conference

    CHI'16
    Sponsor:
    CHI'16: CHI Conference on Human Factors in Computing Systems
    May 7 - 12, 2016
    California, San Jose, USA

    Acceptance Rates

    CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)37
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Semantic Web Approaches in Stack OverflowInternational Journal on Semantic Web & Information Systems10.4018/IJSWIS.35861720:1(1-61)Online publication date: 13-Dec-2024
    • (2024)Beyond the Value for AI Adopters: Analyzing the Impacts of Autonomous Vehicle Testing on Traffic Conditions in CaliforniaSSRN Electronic Journal10.2139/ssrn.4775378Online publication date: 2024
    • (2024)A Disruptive Research Playbook for Studying Disruptive InnovationsACM Transactions on Software Engineering and Methodology10.1145/367817233:8(1-29)Online publication date: 15-Jul-2024
    • (2024)On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the PastProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623341(1-13)Online publication date: 20-May-2024
    • (2024)Toward an AI Knowledge Assistant for Context-Aware Learning Experiences in Software Capstone Project DevelopmentIEEE Transactions on Learning Technologies10.1109/TLT.2024.339673517(1639-1654)Online publication date: 3-May-2024
    • (2024)AI-Powered Chatbots in the Telecommunications Industry in the UAE: Studying the Factors Impacting Consumer Adoption2024 15th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC62082.2024.10827670(1549-1553)Online publication date: 16-Oct-2024
    • (2024)Who are you talking to? How chatbot identity disclosure affects service satisfactionJournal of Travel & Tourism Marketing10.1080/10548408.2024.236975541:8(1090-1106)Online publication date: 15-Jul-2024
    • (2024)Developers’ information seeking in Question & Answer websites through a gender lensJournal of Computer Languages10.1016/j.cola.2024.10126779(101267)Online publication date: Jun-2024
    • (2023)Human mediation leads to higher compliance in digital mental health: field evidence from IndiaFrontiers in Behavioral Economics10.3389/frbhe.2023.12324622Online publication date: 28-Sep-2023
    • (2023)Human Mediation Leads to Higher Compliance in Digital Mental Health: Field Evidence from IndiaSSRN Electronic Journal10.2139/ssrn.4311182Online publication date: 2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media