Elsevier

Computers in Human Behavior

Volume 66, January 2017, Pages 353-362
Computers in Human Behavior

Full length article
Internet cognitive failure relevant to users' satisfaction with content and interface design to reflect continuance intention to use a government e-learning system

https://doi.org/10.1016/j.chb.2016.08.044Get rights and content

Highlights

  • Internet cognitive failure reduces satisfaction with content of e-learning system.

  • Internet cognitive failure reduces satisfaction with interface design.

  • A high level of perceived utility increases users' continuance intention to re-use.

  • Internet cognitive failure can explain difference in willingness to use e-learning.

Abstract

Government e-learning systems have been established for employees in public sectors. To understand the effectiveness of using the systems, the present study focused on the content and interface design of a government e-learning system in Taiwan to explore factors relevant to users' continuance intention to use the system. Data from 150 effective questionnaires were returned for confirmatory factor analysis with structural equation modeling. The results showed that if the users have a high level of Internet cognitive failure, they will have low satisfaction with the content design and interface design of the e-learning system. The results also showed that if users are satisfied with the content design and interface design, they will perceive utility value. Finally, if the users perceive utility value, they will have continuance intention to use the government e-learning system. The results of this study implied that the psychological trait, Internet cognitive failure, plays an essential role for determining the usage of a government e-learning system. In addition, when designing government e-learning systems and deciding where to expend efforts, one should consider how the content and interface design interacts with behavioral intention mediated by utility value.

Introduction

Electronic learning (e-learning), a new approach in education, highlights learner-oriented and life-long teaching/learning processes (Ong, Lai, & Wang, 2004). E-learning systems can be used anytime and anywhere, and knowledge sharing and learning through the Internet can increase users' motivation to learn. E-learning also allows on-job-training to be extended to diverse and geographically dispersed workforces in a cost-efficient manner and can be implemented on-demand and at a lower cost than on-site learning (Lee, Hsieh, & Ma, 2011). Nevertheless, a survey on the use of e-learning conducted by the National Science and Technology Master Plan Program of e-learning (Taiwan Institute for the Information Industry, 2012), revealed that there was a low ratio of active adult users of government e-learning systems and the users experienced poor learning satisfaction. Stoffregen, Pawlowski, and Pirkkalainen (2015) in reviewing e-learning barriers also found there is a gap between satisfaction with system and usage expectancy when introducing e-learning in public sectors. Thus, the question arises as to why users were not satisfied with the government e-learning systems. Although the aforementioned e-learning survey reported low user satisfaction in general, there may be some users who are satisfied, and this implies that individual experiences can enable one to be more or less satisfied regarding their utility perception and attitude towards e-learning (Johnson & Sinatra, 2013).

Whereas research on the acceptance of novel technologies has primarily centered on cognitive dimensions, awareness of the importance of affective dimensions of design in relation to perceptions of utility is growing (Cyr, Head, & Ivanov, 2009). A cognitive-affective model for explaining satisfaction with or acceptance of novel technologies has been highly influential in interface design (Bhattacherjee, 2001a); however, recent research has shown that interface design alone cannot fully explain empirical findings about the perception and use of technologies for learning (Coursaris & van Osch, 2016). In this research, user satisfaction encompassed satisfaction with interface design and also satisfaction with content design. That is, rather than building on either cognitive or affective explanations of user satisfaction, the research model proposed aimed to capture both interfaced design and content design, to construct a more accurate representation of user satisfaction.

Cognitive failure could be the result of internal thoughts (e.g. mind wandering) or external distractions (Broadbent, Cooper, Fitzgerald, & Parkes, 1982). As electronic texts are not static like printed books and magazines (Robinson, 2010), greater effort is required to grasp the information that is presented. When comparing the difference between reading e-learning contents to printed contents, Daniel and Woody (2013) found that it took students significantly more time to read e-learning contents. As a psychological trait, internet cognitive failure has been found to be negatively correlated to users' learning interest when using social media for learning (Authors, 2016). Despite this, the cognitive theory of multimedia learning (CTML) (Mayer, 2005) has highlighted that multimedia facilitates meaningful contexts (Ertmer & Newby, 1993) and Internet usage can enhance student interest by presenting well-designed instructional messages that support cognitive development. Thus, whether internet cognitive failure could also affect users' satisfaction with the interface design and content design of a government e-learning system was the interest of this study.

Perceived effectiveness (i.e. a technology's effect on job performance and enhancing utilitarian value) also plays a pivotal role in users' acceptance of a technology (Coursaris and van Osch, 2016, Coursaris et al., 2012). Utility could be considered a mediator in the relationship between satisfaction and behavioral intention (c.f., Bhattacherjee, 2001a). Johnson and Sinatra (2013) noted that a user's perception in the utility condition demonstrated the greatest degree of facilitating engagement in future tasks. Pereira, Ramos, Gouvêa, and da Costa (2015) studied educational multimedia in public sectors and showed that quality, value, satisfaction and use intention were positively correlated. Thus, this study attempted to examine how individual Internet cognitive failure interacted with satisfaction with content design (SCD) and interface design (SID) to bond to participants' perceived utility value and their continuance intention to use the an government e-learning system.

Section snippets

Literature review

In the barriers and challenges in the development and contextualization of open e-Learning systems, obstacles may arise due to a lack of policy regulations or a poor technical fit of systems to workplaces, which could impede the implementation of learning environments (Pirkkalainen & Pawlowski, 2014). Thus, this study focused on SCD and SID to realize their interaction with an individual trait and the perception of utility.

Research hypotheses and model

Koo (2009) highlighted that the behavioral studies of e-learning can be classified into three broad categories: (1) the psychology of learners; (2) the appealing features of virtual environments; (3) the cognitive and perceptual factors that influence attitudes and behaviors. Whether e-learning achieves the effectiveness of traditional learning depends on many factors (e.g., Selim, 2007, Sun et al., 2008, Tzeng et al., 2007, Wang et al., 2007). Accordingly, the following research hypotheses

Methods

This study used a questionnaire and targeted individuals who used the “Communication and Human Relationships” (CHR) course of the e-college of The National Academy of Civil Service (NACS) as the respondents.

Results

The analysis was run in two steps. First, descriptive analysis was applied to test the reliability and validity of measuring questionnaire. Second, we used LISREL8.8 for structural equation modeling to explore the relationship between the variables to examine the pathway to verify the research framework.

Discussion

The model proposed in this research offers a comprehensive framework for assessing Internet cognitive failure's effects on users' perceptions of utility and SID and SCD. The path analysis results showed that learners who had high internet cognitive failure would have low SCD and SID. If users' had high SCD and SID, they would perceive utility value and have continuance intention to use the e-learning system.

In examining Hypothesis 1 and 2, the results of this study indicated that Internet

Conclusion

E-Learning offers the potential to increase access to learning resources, access that occurs in the deployment of the Internet environment with the development of digital teaching materials (McFarland & Hamilton, 2006). Although the use of e-learning systems is increasing, and they are beneficial in organizations and educational institutions, the problem of underutilization remains (Ong et al., 2004). The results of this study revealed that Internet cognitive failure would decrease SID and SCD

Limitation and future study

Mecacci and Righi (2006) found significant negative correlations between age and cognitive failure. That is, self-reported cognitive failures seem to be related to longitudinal changes in cognitive functioning (Hohman, Beason-Held, Lamar, & Resnick, 2011). In line with this, examining the demographic variable of age may reveal interesting results. However, this study was limited to investigating cognitive-affective variables in relation to the experience of using a governmental e-learning

Acknowledgement

This research was partially supported by the “Aim for the Top University Project” of National Taiwan Normal University (NTNU), sponsored by the Ministry of Education, Taiwan and the “International Research-Intensive Center of Excellence Program” of NTNU and Ministry of Science and Technology, Taiwan (MOST 103-2911-I-003-301 and MOST 101-2511-S-003-056-MY3 and MOST 104-2911-I-003-301).

References (93)

  • G. Falloon

    Young students using iPads: App design and content influences on their learning pathways

    Computers & Education

    (2013)
  • C. Gonzalez et al.

    A cognitive modeling account of simultaneous learning and fatigue effects

    Cognitive Systems Research

    (2011)
  • M.L. Johnson et al.

    Use of task-value instructional inductions for facilitating engagement and conceptual change

    Contemporary Educational Psychology

    (2013)
  • D.M. Koo

    The moderating role of locus of control on the links between experiential motives and intention to play online games

    Computers in Human Behavior

    (2009)
  • D.S. Lee

    .The effect of visualizing the flow of multimedia content among and inside devices

    Applied Ergonomics

    (2009)
  • M.C. Lee

    Explaining and predicting users' continuance intention toward e-learning: An extension of the expectation-confirmation model

    Computers & Education

    (2010)
  • Y.H. Lee et al.

    A model of organizational employees' e-learning systems acceptance

    Knowledge-Based Systems

    (2011)
  • S. Leuthold et al.

    Beyond web content accessibility guidelines: Design of enhanced text user interfaces for blind internet users

    International Journal of Human-Computer Studies

    (2008)
  • L.L. Lohr

    Designing the instructional interface

    Computers in Human Behavior

    (2000)
  • D.J. McFarland et al.

    Adding contextual specificity to the technology acceptance model

    Computers in Human Behavior

    (2006)
  • L. Mecacci et al.

    Cognitive failures, metacognitive beliefs, and aging

    Personality and Individual Differences

    (2006)
  • C.S. Ong et al.

    Factors affecting engineers' acceptance of asynchronous e-learning systems in high-tech companies

    Information & Management

    (2004)
  • F.A.M. Pereira et al.

    Satisfaction and continuous use intention of e-learning service in Brazilian public organizations

    Computers in Human Behavior

    (2015)
  • C.W. Phang et al.

    Investigating organizational learning in eGovernment projects: A multi-theoretic approach. eGovernment strategies: ICT innovation in international public sector contexts

    Journal of Strategic Information Systems

    (2008)
  • H. Pirkkalainen et al.

    Global social knowledge management: Understanding barriers for global workers utilizing social software

    Computers in Human Behavior

    (2014)
  • A.B. Satpute et al.

    The functional neural architecture of self-reports of affective experience

    Biological Psychiatry

    (2013)
  • H.M. Selim

    Critical success factors for e-learning acceptance: Confirmatory factor models

    Computers & Education

    (2007)
  • S.H.P. Shyu et al.

    Elucidating usage of e-government learning: A perspective of the extended technology acceptance model

    Government Information Quarterly

    (2011)
  • H. Staats et al.

    Where to recover from attentional fatigue: An expectancy-value analysis of environmental preference

    Journal of Environmental Psychology

    (2003)
  • J. Stoffregen et al.

    A Barrier Framework for open E-Learning in public administrations

    Computers in Human Behavior

    (2015)
  • Y.T. Sung et al.

    Evaluating the reliability and impact of a quality assurance system for E-learning courseware

    Computers & Education

    (2011)
  • E. Sung et al.

    Affective impact of navigational and signaling aids to e-learning

    Computers in Human Behavior

    (2012)
  • P.C. Sun et al.

    What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction

    Computers & Education

    (2008)
  • A.G. Sutcliffe et al.

    A method and advisor tool for multimedia user interface design

    International Journal of Human-Computer Studies

    (2006)
  • S.P. Tipper et al.

    Individual differences in selective attention: The relation of priming and interference to cognitive failure

    Personality and Individual Differences

    (1987)
  • G.H. Tzeng et al.

    Evaluating intertwined effects in e-learning program: A novel hybrid MCDM model based on factor analysis and DEMATEL

    Expert Systems with Applications

    (2007)
  • I. Vekiri

    Information science instruction and changes in girls' and boy's expectancy and value beliefs: In search of gender-equitable pedagogical practices

    Computers & Education

    (2013)
  • Y.S. Wang et al.

    Measuring e-learning systems success in an organizational context: Scale development and validation

    Computers in Human Behavior

    (2007)
  • N.M. Yusoff et al.

    Investigating cognitive task difficulties and expert skills in e-Learning storyboards using a cognitive task analysis technique

    Computers & Education

    (2012)
  • D. Alonso-Ríos et al.

    Usability: A critical analysis and a taxonomy

    International Journal of Human-Computer Interaction

    (2009)
  • Authors...
  • Authors...
  • Belisle, M. J.. (2007). Temporal behavior of Taylor-Couette flow sinusoidally modulated about a zero mean. Paper...
  • A. Bhattacherjee

    Understanding information systems continuance. An expectation–confirmation model

    MIS Quarterly

    (2001)
  • A. Bhattacherjee et al.

    Influence processed for information technology acceptance: An elaboration likelihood model

    MIS Quarterly

    (2006)
  • D.E. Broadbent et al.

    The cognitive failures questionnaire and its correlates

    British Journal of Clinical Psychology

    (1982)
  • Cited by (84)

    • The perils of hotel technology: The robot usage resistance model

      2022, International Journal of Hospitality Management
    • Predicting continuance intention to fintech chatbot

      2022, Computers in Human Behavior
      Citation Excerpt :

      That is, this research uses a potential growth model to investigate how the three social cues at time 1 affect the positive changes in emotional arousal development (changes from time 1 to time 3), and how these positive changes lead to follow-up positive changes in attitude toward the fintech chatbot development and CI development. The view of changes in these variables is important because previous studies were cross-sectional design instead of examining the development (change) of CI with its antecedents over time (e.g., Bae, 2018; Hong, Tai, Hwang, Kuo, & Chen, 2017; Valaei & Baroto, 2017). Therefore, there is little empirical evidence on whether these variables increase, decrease, or stabilize over time.

    • Social media and micro-lessons: A new paradigm of online learning

      2024, Optimizing Education Through Micro-Lessons: Engaging and Adaptive Learning Strategies
    View all citing articles on Scopus
    View full text