skip to main content
10.1145/3527188.3563918acmotherconferencesArticle/Chapter ViewAbstractPublication PageshaiConference Proceedingsconference-collections
short-paper

A Bona Fide Turing Test

Published: 05 December 2022 Publication History

Abstract

The constantly rising demand for human-like conversational agents and the accelerated development of natural language processing technology raise expectations for a breakthrough in intelligent machine research and development. However, measuring intelligence is impossible without a proper test. Alan Turing proposed a test for machine intelligence based on imitation and unconstrained conversations between a machine and a human. To the best of our knowledge, no one has ever conducted Turing’s test as Turing prescribed, even though the Turing Test has been a bone of contention for more than seventy years. Conducting a bona fide Turing Test will contribute to machine intelligence evaluation research and has the potential to advance AI researchers in their ultimate quest, developing an intelligent machine.

References

[1]
R. Adam, U. Hershberg, Y. Schul, and S. Solomon. 2004. Testing The Turing Test—Do Men Pass It?International Journal of Modern Physics C 15, 08 (2004), 1041–1047. https://doi.org/10.1142/S0129183104006522
[2]
S. Argamon, M. Koppel, J. Fine, and A. R. Shimoni. 2003. Gender, genre, and writing style in formal written texts. Text & talk 23, 3 (2003), 321–346. https://doi.org/10.1515/text.2003.014
[3]
D.J.H. Burden. 2008. Deploying embodied AI into virtual worlds. In Applications and Innovations in Intelligent Systems XVI (London), T. Allen, R. Ellis, and M. Petridis (Eds.). Springer, 103–115. https://doi.org/10.1007/978-1-84882-215-3_8
[4]
H. Collins and R. Evans. 2014. Quantifying the tacit: The imitation game and social fluency. Sociology 48, 1 (2014), 3–19. https://doi.org/10.1177/0038038512455735
[5]
B.J. Copeland. 2000. The Turing Test. Minds and Machines 10, 4 (2000), 519–539. https://doi.org/10.1023/A:1011285919106
[6]
J. Copeland and D. Proudfoot. 2009. Turing’s Test: A philosophical and historical guide. In Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer, G. Epstein, R.and Roberts and G. Beber (Eds.). Springer, Dordrecht, 119–138. https://doi.org/10.1007/978-1-4020-6710-5_9 Export Date: 10 July 2022; Cited By: 14.
[7]
A. Følstad and M. Skjuve. 2019. Chatbots for customer service: user experience and motivation. In Proceedings of the 1st international conference on conversational user interfaces. 1–9. https://doi.org/10.1145/3342775.3342784
[8]
A. J Gonzalez, J. R Hollister, R. F DeMara, J. Leigh, B. Lanman, S. Lee, S. Parker, C.r Walls, J. Parker, and J. Wong. 2017. AI in informal science education: Bringing Turing back to life to perform the Turing test. International Journal of Artificial Intelligence in Education 27, 2(2017), 353–384. https://doi.org/10.1007/s40593-017-0144-1
[9]
M. Jain, P. Kumar, R. Kota, and S.N. Patel. 2018. Evaluating and informing the design of chatbots. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong). Association for Computing Machinery, 895–906. https://doi.org/10.1145/3196709.3196735
[10]
B. M. Lake, T. D. Ullman, J. B. Tenenbaum, and S. J. Gershman. 2017. Building machines that learn and think like people. Behavioral and brain sciences 40 (2017). https://doi.org/10.1017/S0140525X16001837
[11]
X. Luo, S. Tong, Z. Fang, and Z. Qu. 2019. Frontiers: Machines vs. humans: The impact of artificial intelligence chatbot disclosure on customer purchases. Marketing Science 38, 6 (2019), 937–947. https://doi.org/10.1287/mksc.2019.1192
[12]
J. H Moor. 2001. The status and future of the Turing test. Minds and Machines 11, 1 (2001), 77–93. https://doi.org/10.1023/A:1011218925467
[13]
W. Patterson, J. Boboye, S. Hall, and M. Hornbuckle. 2017. The gender Turing test. International Conference on Applied Human Factors and Ergonomics, 281–289. https://doi.org/10.1007/978-3-319-60585-2_26
[14]
D. Proudfoot. 2011. Anthropomorphism and AI: Turing’s much misunderstood imitation game. Artificial Intelligence 175, 5-6 (2011), 950–957. https://doi.org/10.1016/j.artint.2011.01.006
[15]
H. Shah and K. Warwick. 2010. Testing Turing’s five minutes, parallel‐paired imitation game. Kybernetes 39, 3 (2010), 449–465. https://doi.org/10.5220/0005736802150222
[16]
N. Tiku. 2022. The Google engineer who thinks the company’s AI has come to life. Retrieved August 01, 2022 from https://www.washingtonpost.com/technology/2022/06/11/google-ai-lamda-blake-lemoine/
[17]
A. Turing, R. Braithwaite, G. Jefferson, and M. Newman. 2004. Can Automatic Calculating Machines Be Said To Think? (1952). In The Essential Turing, Jack Copeland (Ed.). Clarendon Press, 487–515.
[18]
A. M. Turing. 1950. Computing machinery and intelligence. Mind LIX, 236 (1950), 433–460. https://doi.org/10.1093/mind/LIX.236.433
[19]
A. M. Turing. 2004. Intelligent machinery. In The Essential Turing, Jack Copeland (Ed.). Clarendon Press, 395–432.
[20]
K. Warwick and H. Shah. 2016. Can machines think? A report on Turing test experiments at the Royal Society. Journal of experimental & Theoretical artificial Intelligence 28, 6(2016), 989–1007. https://doi.org/10.1080/0952813X.2015.1055826

Cited By

View all
  • (2023)International Governance of Civilian AI: A Jurisdictional Certification ApproachSSRN Electronic Journal10.2139/ssrn.4579899Online publication date: 2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
HAI '22: Proceedings of the 10th International Conference on Human-Agent Interaction
December 2022
352 pages
ISBN:9781450393232
DOI:10.1145/3527188
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Turing test
  2. artificial intelligence
  3. conversational agent
  4. imitation game

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

HAI '22
HAI '22: International Conference on Human-Agent Interaction
December 5 - 8, 2022
Christchurch, New Zealand

Acceptance Rates

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)24
  • Downloads (Last 6 weeks)1
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)International Governance of Civilian AI: A Jurisdictional Certification ApproachSSRN Electronic Journal10.2139/ssrn.4579899Online publication date: 2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media