skip to main content
10.1145/3613372.3614189acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

A Report on the Use of ChatGPT in Software Engineering and Systems Analysis Courses

Published:25 September 2023Publication History

ABSTRACT

ChatGPT is a natural language model that works as a virtual chat assistant. It has the potential to be used for fostering classroom discussions and addressing student needs when the professor is not accessible. Although it is still early to assess the impact of ChatGPT and similar technologies, there is a considerable discussion on social media and blogs regarding the aspirations and opportunities of utilizing ChatGPT in the software industry and education. The main perception is that ChatGPT can serve as a support tool but should not completely replace interpersonal interaction, as face-to-face dialogue remains crucial for the development of interpersonal skills and a deeper understanding of concepts. This article reports a recent classroom experience in the subjects of Software Engineering and Systems Analysis, while also analyzing ChatGPT’s responses to student inquiries.

References

  1. Aakash Ahmad, Muhammad Waseem, Peng Liang, Mahdi Fahmideh, Mst Shamima Aktar, and Tommi Mikkonen. 2023. Towards Human-Bot Collaborative Software Architecting with ChatGPT. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering (Oulu, Finland) (EASE ’23). Association for Computing Machinery, New York, NY, USA, 279–285. https://doi.org/10.1145/3593434.3593468Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. David Baidoo-Anu and Leticia Owusu Ansah. 2023. Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Available at SSRN 4337484 (2023).Google ScholarGoogle Scholar
  3. João Fernando Costa Júnior, Uilliane Faustino de Lima, Mário Domingos Leme, Leonardo Silva Moraes, Jonas Bezerra da Costa, Diogo Magalhães de Barros, Maria Aparecida de Moura Amorim Sousa, and Luis Carlos Ferreira de Oliveira. 2023. A inteligência artificial como ferramenta de apoio no ensino superior. Rebena - Revista Brasileira de Ensino e Aprendizagem 6 (2023), 246–269. https://rebena.emnuvens.com.br/revista/article/view/111Google ScholarGoogle Scholar
  4. Javier Cámara, Javier Troya, Lola Burgueño, and Antonio Vallecillo. 2023. On the assessment of generative AI in modeling tasks: an experience report with ChatGPT and UML. Software and Systems Modeling (May 2023). https://doi.org/10.1007/s10270-023-01105-5Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Patrícia Homobono Brito de Moura, Caio Renan Goes Serrão, Roger Leomar da Silva Ferreira, Daniele de Araújo Moysés, and Maria Dulcimar de Brito Silva. 2012. Aplicação de Softwares Educacionais em Química: Um Estudo de caso em uma Turma do Ensino Médio em uma Escola Estadual da cidade de Belém-PA.XVI ENEQ/X EDUQUI (2012).Google ScholarGoogle Scholar
  6. Mehmet Firat. 2023. How chat GPT can transform autodidactic experiences and open education. Department of Distance Education, Open Education Faculty, Anadolu Unive (2023).Google ScholarGoogle Scholar
  7. Brian Frederick. 2023. Will ChatGPT Take Your Job?Retrieved May 23, 2023 from https://www.searchenginejournal.com/will-chatgpt-take-your-job/476189/Google ScholarGoogle Scholar
  8. Ankur Joshi, Saket Kale, Satish Chandel, and D Kumar Pal. 2015. Likert scale: Explored and explained. British journal of applied science & technology 7, 4 (2015), 396.Google ScholarGoogle Scholar
  9. Enkelejda Kasneci, Kathrin Sessler, Stefan Küchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan Günnemann, Eyke Hüllermeier, Stephan Krusche, Gitta Kutyniok, Tilman Michaeli, Claudia Nerdel, Jürgen Pfeffer, Oleksandra Poquet, Michael Sailer, Albrecht Schmidt, Tina Seidel, Matthias Stadler, Jochen Weller, Jochen Kuhn, and Gjergji Kasneci. 2023. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103 (2023), 102274. https://doi.org/10.1016/j.lindif.2023.102274Google ScholarGoogle ScholarCross RefCross Ref
  10. Fabian Kieser, Peter Wulff, Jochen Kuhn, and Stefan Küchemann. 2023. Educational data augmentation in physics education research using ChatGPT. arxiv:2307.14475 [physics.ed-ph]Google ScholarGoogle Scholar
  11. Brady D Lund and Ting Wang. 2023. Chatting about ChatGPT: how may AI and GPT impact academia and libraries?Library Hi Tech News 40, 3 (2023), 26–29.Google ScholarGoogle Scholar
  12. Wei Ma, Shangqing Liu, Wenhan Wang, Qiang Hu, Ye Liu, Cen Zhang, Liming Nie, and Yang Liu. 2023. The Scope of ChatGPT in Software Engineering: A Thorough Investigation. arxiv:2305.12138 [cs.SE]Google ScholarGoogle Scholar
  13. Melanie Mitchell and David C. Krakauer. 2023. The debate over understanding in AI’s large language models. Proceedings of the National Academy of Sciences 120, 13 (2023), e2215907120. https://doi.org/10.1073/pnas.2215907120Google ScholarGoogle ScholarCross RefCross Ref
  14. Santa Fe Institute Office of Communications. 2023. Could AI ever truly understand?Retrieved May 23, 2023 from https://www.santafe.edu/news-center/news/could-ai-ever-truly-understandGoogle ScholarGoogle Scholar
  15. OpenAI. [n. d.]. Introducing ChatGPT. Retrieved May 15, 2023 from https://openai.com/blog/chatgptGoogle ScholarGoogle Scholar
  16. Guilherme Passero, Nélia Elaine Wahlbrink Engster, and Rudimar Luís Scaranto Dazzi. 2016. Uma revisão sobre o uso das TICs na educação da Geração Z. Renote 14, 2 (2016).Google ScholarGoogle Scholar
  17. Tung Phung, Victor-Alexandru Pădurean, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, and Gustavo Soares. 2023. Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors. arxiv:2306.17156 [cs.CY]Google ScholarGoogle Scholar
  18. Quora. 2023. Can ChatGPT replace software Developers?Retrieved May 23, 2023 from https://www.quora.com/Can-ChatGPT-replace-software-DevelopersGoogle ScholarGoogle Scholar
  19. Rafaela Menezes da Silva Reis, Bruno Silva Leite, and Marcelo Brito Carneiro Leão. 2021. Estratégias didáticas envolvidas no uso das TIC: o que os professores dizem sobre seu uso em sala de aula?ETD Educação Temática Digital 23, 2 (2021), 551–571.Google ScholarGoogle Scholar
  20. Prabin Sharma, Kisan Thapa, Dikshya Thapa, Prastab Dhakal, Mala Deep Upadhaya, Santosh Adhikari, and Salik Ram Khanal. 2023. Performance of ChatGPT on USMLE: Unlocking the Potential of Large Language Models for AI-Assisted Medical Education. arxiv:2307.00112 [cs.CY]Google ScholarGoogle Scholar
  21. Academia Stackexchange. 2023. Should Chatgpt be used in a software development?Retrieved May 23, 2023 from https://academia.stackexchange.com/questions/192164/should-chatgpt-be-used-in-a-software-developmentGoogle ScholarGoogle Scholar
  22. Nigar M Shafiq Surameery and Mohammed Y Shakor. 2023. Use chat gpt to solve programming bugs. International Journal of Information Technology & Computer Engineering (IJITC) ISSN: 2455-5290 3, 01 (2023), 17–22.Google ScholarGoogle Scholar
  23. Luis Antonio Tavares, Matheus Carvalho Meira, and Sergio Ferreira do Amaral. 2020. Inteligência Artificial na Educação: Survey. Brazilian Journal of Development 6, 7 (2020), 48699–48714.Google ScholarGoogle ScholarCross RefCross Ref
  24. H. Holden Thorp. 2023. ChatGPT is fun, but not an author. Science 379, 6630 (2023), 313–313. https://doi.org/10.1126/science.adg7879 arXiv:https://www.science.org/doi/pdf/10.1126/science.adg7879Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Report on the Use of ChatGPT in Software Engineering and Systems Analysis Courses

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SBES '23: Proceedings of the XXXVII Brazilian Symposium on Software Engineering
        September 2023
        570 pages
        ISBN:9798400707872
        DOI:10.1145/3613372

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 September 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate147of427submissions,34%
      • Article Metrics

        • Downloads (Last 12 months)149
        • Downloads (Last 6 weeks)22

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format