skip to main content
10.1145/3660043.3660182acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicieaiConference Proceedingsconference-collections
research-article

How Perceived Organizational Support Influences University Students45 Intention to Use AI Language Models in Course Learning: An Exploratory Study Based on the Technology Acceptance Model

Published: 30 May 2024 Publication History

Abstract

With the maturity and proliferation of large-scale artificial intelligence language models, it has become challenging to prevent university students from using chatbots like ChatGPT as auxiliary tools for course learning. An increasing number of higher education institutions are adopting a positive attitude towards AI language models and encouraging students to use various chatbots. Based on the Technology Acceptance Model (TAM), this study constructs a new theoretical model to explore the influence of perceived organizational support (POS) on students' intention to use AI language models in course learning. Using questionnaire data from 146 university students, this study validates the hypothesized model using PLS-SEM. We found: firstly, TAM has good explanatory power for the intention to use AI language models among university students, with Perceived Usefulness (PU) and Perceived Ease of Use (PEU) both having a positive and significant impact on Behavioral Intention (BI); secondly, although POS cannot directly affect BI, it can positively and effectively influence BI through the mediating roles of PU and PEU. The model has a high explanatory power (R2=0.697), providing valuable theoretical guidance for universities to support and regulate the use of AI language models in course learning by students.

References

[1]
D. Jurafsky and J. H. Martin. 2019. Speech and Language Processing (3rd ed.). Prentice Hall.
[2]
T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, and D. Amodei. 2020. Language models are few-shot learners. In Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS 2020), 1–22. https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
[3]
J. Devlin, M. W. Chang, K. Lee, and K. Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), 4171–4186. https://doi.org/10.18653/v1/N19-1423
[4]
E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT 2021), 1–18. https://doi.org/10.1145/3442188.3445922
[5]
N. I. M Rahim, N. A. Iahad, A. F. Yusof, and M. A. Al-Sharafi. 2022. AI-Based chatbots adoption model for higher-education institutions: A hybrid PLS-SEM-Neural network modelling approach. Sustainability 14, 19 (Sept. 2022), 12726. https://doi.org/10.3390/su141912726
[6]
H. Yu. 2023. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Frontiers in Psychology 14 (Jan. 2023). https://doi.org/10.3389/fpsyg.2023.1181712
[7]
C. Y. Lin and N. Xu. 2022. Extended TAM model to explore the factors that affect intention to use AI robotic architects for architectural design. Technology Analysis & Strategic Management 34, 3 (2022), 349–362. https://doi.org/10.1080/09537325.2021.1900808
[8]
Y. Shaengchart. 2023. A conceptual review of TAM and ChatGPT usage intentions among higher education students. Advance Knowledge for Executives 2, 3 (2023). https://ssrn.com/abstract=4581231
[9]
H. Jo. 2023. Decoding the ChatGPT mystery: A comprehensive exploration of factors driving AI language model adoption. Information Development (2023). https://doi.org/10.1177/02666669231202764
[10]
G. Liu and C. Ma. 2023. Measuring EFL learners’ use of ChatGPT in informal digital learning of English based on the technology acceptance model. Innovation in Language Learning and Teaching (2023), 1–14. https://doi.org/10.1080/17501229.2023.2240316
[11]
B. Foroughi, M. G. Senali, M. Iranmanesh, A. Khanfar, M. Ghobakhloo, N. Annamalai, and B. Naghmeh-Abbaspour. 2023. Determinants of intention to use ChatGPT for educational purposes: Findings from PLS-SEM and fsQCA. International Journal of Human–Computer Interaction (2023), 1–20. https://doi.org/10.1080/10447318.2023.2226495
[12]
F. D. Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13, 3 (Sept. 1989), 319–340. https://doi.org/10.2307/249008
[13]
J. H. Huang, Y. R. Lin, and S. T. Chuang. 2007. Elucidating user behavior of mobile learning: A perspective of the extended technology acceptance model. The Electronic Library 25, 5 (2007), 585–598. https://doi.org/10.1108/02640470710829569
[14]
P. Ifinedo. 2017. Examining students' intention to continue using blogs for learning: Perspectives from technology acceptance, motivational, and social-cognitive frameworks. Computers in Human Behavior 72 (2017), 189–199. https://doi.org/10.1016/j.chb.2016.12.049
[15]
L. Ye, M. Kuang, and S. Liu. 2022. ICT Self-Efficacy, Organizational Support, Attitudes, and the Use of Blended Learning: An Exploratory Study Based on English Teachers in Basic Education. Frontiers in Psychology 13 (2022). https://doi.org/10.3389/fpsyg.2022.941535
[16]
J. C. Nunnally and I. H. Bernstein. 1994. Psychometric Theory. McGraw-Hill.
[17]
C. Fornell and D. F. Larcker. 1981. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research 18, 1 (1981), 39–50. https://doi.org/10.1177/002224378101800104

Index Terms

  1. How Perceived Organizational Support Influences University Students45 Intention to Use AI Language Models in Course Learning: An Exploratory Study Based on the Technology Acceptance Model

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICIEAI '23: Proceedings of the 2023 International Conference on Information Education and Artificial Intelligence
    December 2023
    1132 pages
    ISBN:9798400716157
    DOI:10.1145/3660043
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 30 May 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICIEAI 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 63
      Total Downloads
    • Downloads (Last 12 months)63
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media