Abstract
Human cognitive performance is enhanced by the use of tools. For example, a human can produce a much greater, and more accurate, volume of mathematical calculation in a unit of time using a calculator or a spreadsheet application on a computer. Such tools have taken over the burden of lower-level cognitive “grunt work” but the human still serves the role of the expert performing higher-level thinking and reasoning. Recently, however, unsupervised, deep, machine learning has produced cognitive systems able to outperform humans in several domains. When humans use these tools in a human/cog ensemble, the human’s cognitive ability is augmented. In some cases, even non-experts can achieve, and even exceed, the performance of experts in a particular domain—synthetic expertise. A new cognitive system, ChatGPT, has burst onto the scene during the past year. This paper investigates human cognitive augmentation due to using ChatGPT by presenting the results of two experiments comparing responses created using ChatGPT with results created not using ChatGPT. We find using ChatGPT does not always result in cognitive augmentation and does not yet replace human judgement, discernment, and evaluation in certain types of tasks. In fact, ChatGPT was observed to result in misleading users resulting in negative cognitive augmentation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abràmoff, M.D., Lavin, P.T., Birch, M., Shah, N., Folk, J.C.: . Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Digital Med. 1, 39 (2018). https://www.nature.com/articles/s41746-018-0040-6, (Accessed January 2024)
Ackoff, R.: From Data to Wisdom. J. Appli. Syst. Analy. 16 (1989). https://faculty.ung.edu/kmelton/Documents/DataWisdom.pdf (Accessed February 2023)
Ali, R., et al.: Performance of CHATGPT and GPT-4 on Neurosurgery Written Board Examinations. Neurosurgery (2023). https://doi.org/10.1227/neu.0000000000002632
Anderson, L.W., Krathwohl, D.R., Airasian, P.W., Cruik-shank, K.A., Mayer, R.E.: A taxonomy for learning, teaching, and assessing: a revision of Bloom's taxonomy of educational objectives, Pearson (2001)
Bloom, B.S., Engelhart, M.D., Furst, E.J., Hill, W.H., Krath-wohl, D.R.: Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York: David McKay Company (1956)
Brin, D., et al.: Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments. Sci. Rep. 13(1) (2023). https://doi.org/10.1038/s41598-023-43436-9
Duong, D., Solomon, B.D.: Analysis of large-language model versus human performance for genetics questions. Eur. J. Hum. Genet. (2023). https://doi.org/10.1038/s41431-023-01396-8
Elyoseph, Z., Hadar-Shoval, D., Asraf, K., Lvovsky, M.: ChatGPT outperforms humans in emotional awareness evaluations. Front. Psychol. 14 (2023). https://doi.org/10.3389/fpsyg.2023.1199058
Fulbright, R.: The Cogs Are Coming: The Cognitive Augmentation Revolution, Proceedings of the Association Supporting Computer Users in Education 2015 (49th, Myrtle Beach, SC) (2016a). https://eric.ed.gov/?q=cognitive+development+in+early+childhood&ff1=dtysince_2014&pg=1340&id=ED570900, (Accessed January 2024)
Fulbright, R.: How personal cognitive augmentation will lead to the democratization of expertise. Adv. Cognitive Syst. 4 (2016b). http://www.cogsys.org/posters/2016/poster-2016-3.pdf, (Acccessed January 2024)
Fulbright, R.: Cognitive augmentation metrics using representational information theory. In: Schmorrow D., Fidopiastis C. (eds.) Augmented Cognition. Enhancing Cognition and Behavior in Complex Human Environments, AC 2017. LNCS, vol. 10285. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58625-0_3
Fulbright, R.: On measuring cognition and cognitive augmentation, In: Yamamoto, S., Mori, H. (eds.) Human Interface and the Management of Information, HIMI 2018. LNCS, vol. 10905. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92046-7_41
Fulbright, R.: Calculating Cognitive Augmentation -A Case Study, In: Schmorrow, D., Fidopiastis, C. (eds.) Augmented Cognition, AC 2019. LNCS, vol. 11580. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22419-6_38
Fulbright, R.: Democratization of Expertise: How Cognitive Systems Will Revolutionize Your Life. CRC Press, Boca Raton (2020)
Fulbright, R.: The expertise level. In: Schmorrow D., Fidopiastis C. (eds.) Augmented Cognition. Human Cognition and Behavior. HCII 2020. LNCS, vol. 12197. Springer, Cham (2020a). https://doi.org/10.1007/978-3-030-50439-7_4
Fulbright, R., Walters, G.: Synthetic Expertise. In: Schmorrow D., Fidopiastis C. (eds.) Augmented Cognition. Human Cognition and Behavior. HCII 2020. LNCS, vol. 12197. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50439-7_3
Fulbright R. and McGaha, S.: The Effect of Information Type on Human Cognitive Augmentation. In: Schmorrow, D., Fidopiastis, C. (eds.), Augmented Cognition: HCII 2023, LNCS, vol. 14019, pp. 206- 220. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-35017-7_14
Gil, D.: Cognitive systems and the future of expertise, YouTube video located at (2019) https://www.youtube.com/watch?v=0heqP8d6vtQ (Accessed February 2023)
Gregory, M.: AI Trained on Old Scientific Papers Makes Discoveries Humans Missed, Vice Internet page located at (2019). https://www.vice.com/en_in/article/neagpb/ai-trained-on-old (Accessed January 2024)
Haenssle, H.A., et al.: Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Annals Oncol. 29(8), 1836–1842 (2018). https://academic.oup.com/annonc/article/29/8/1836/5004443, (Accessed November 2019)
Jarou, Z.J., Dakka, A., McGuire, D., Bunting, L.: ChatGPT versus human performance on emergency medicine board preparation questions. Ann. Emerg. Med. (2023). https://doi.org/10.1016/j.annemergmed.2023.08.010
Katz, D.M., Bommarito, M.J., Gao, S., Arredondo, P.: GPT-4 Passes the Bar Exam. SSRN Electron. J. (2023). https://doi.org/10.2139/ssrn.4389233
Kelly, J.E., Hamm, S.: Smart Machines: IBMs Watson and the Era of Cognitive Computing. Columbia Business School Publishing, Columbia University Press, New York, NY (2013)
Kung, T. H., et al.: Performance of ChatGPT on USMLE: potential for ai-assisted medical education using large language models. PLOS Digital Health 2(2) (2023). https://doi.org/10.1371/journal.pdig.0000198
Kurtzman, L.: AI Rivals Expert Radiologists at Detecting Brain Hemorrhages: Richly Annotated Training Data Vastly Improves Deep Learning Algorithm’s Accuracy, UCSF News, University of California San Francisco (2019). https://www.ucsf.edu/news/2019/10/415681/ai-rivals-expert-radiologists-detecting-brain-hemorrhages, (Accessed January 2024)
Lavars, N.: Machine learning algorithm detects signals of child depression through speech, New Atlas, published May 7 (2019). https://newatlas.com/machine-learning-algorithm-depression/59573/ (Accessed February 2023)
Li, S. W., et al.: ChatGPT Outscored Human Candidates in a Virtual Objective Structured Clinical Examination in Obstetrics and Gynecology. Am. J. Obstetrics Gynecol. 229(2) (2023). https://pubmed.ncbi.nlm.nih.gov/37088277/, (Accessed January 2024)
Liévin, V., Hother, C. E., and Winther, O.: Can Large Language Models Reason About Medical Questions? arXiv (2023). https://doi.org/10.48550/arXiv.2207.08143
Myers, K. D., et al.: Precision screening for familial hypercholesterolaemia: a machine learning study applied to electronic health encounter data. Lancet Digital Health (2019). https://www.thelancet.com/journals/landig/article/PIIS2589–7500(19)30150–5/fulltext , (Accessed January 2024)
Noy, S., Zhang, W.: Experimental evidence on the productivity effects of generative artificial intelligence. Science 381(6654), 187–192 (2023). https://www.science.org/, https://doi.org/10.1126/science.adh2586 , (Accessed January 2024)
[Stevens] Listen to your heart: AI tool detect heart diseases that doctors often miss, Stevens Institute of Technology media release (2023). https://www.stevens.edu/news/listen-to-your-heart-ai-tool-detects-cardiac-diseases-that-doctors-often#%20 , (Accessed January 2024)
Sandoiu, A.: Artificial intelligence better than humans at spotting lung cancer. Medical News Today Newsletter, May 20 (2019). https://www.medicalnewstoday.com/articles/325223.php#1, (Aaccessed November 2019)
Tshitoyan, V., et al.: Unsupervised word embeddings capture latent knowledge from materials science literature Nature 571 (2019). https://www.nature.com/articles/s41586–019–1335–8 , (Accessed January 2024)
Towers-Clark, C.: The Cutting-Edge of AI Cancer Detection, Forbes, published April 30 (2019). https://www.forbes.com/sites/charlestowersclark/2019/04/30/the-cutting-edge-of-ai-cancer-detection/#45235ee77336 last accessed February 2023
Wehner, M.: . AI is now better at predicting mortality than human doctors, New York Post, published May 14 (2019). https://nypost.com/2019/05/14/ai-isnow-better-at-predicting-mortality-than-humandoctors/?utm_campaign=partnerfeed&utm_medium=syndicated&utm_source=flipboard last accessed February 2023
Wladawsky-Berger, I.: The Era of Augmented Cognition, The Wall Street Journal: CIO Report Internet page located at (2015). http://blogs.wsj.com/cio/2013/06/28/the-era-of-augmented-cognition/ (Accessed February 2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Fulbright, R., Morrison, M. (2024). Does Using ChatGPT Result in Human Cognitive Augmentation?. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2024. Lecture Notes in Computer Science(), vol 14694. Springer, Cham. https://doi.org/10.1007/978-3-031-61569-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-61569-6_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-61568-9
Online ISBN: 978-3-031-61569-6
eBook Packages: Computer ScienceComputer Science (R0)