Skip to main content
Log in

Continuance model of formative computer-based assessment (CBA): Considering the effects of self-regulation and social influence

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Since continuance usage of e-learning can truly provide learning benefits, many studies have developed e-learning continuance models. A computer-based assessment (CBA) is often used for online formative assessment and thus is performed many times in a course (basically one formative assessment for one chapter/unit.). However, some students are unable to sustain and persist in a series of formative CBA activities. This study focused on developing a formative CBA continuance model. The study first investigated the moderating effect of “self-regulation” on continuance intention to continuance usage. Additionally, the study also considered the direct effect of “social influence” on continuance intention. The experiment lasted one semester and was performed in a college-level course taken by 152 undergraduates in Taiwan. During the experiment, five-time (formative) CBAs were conducted before the midterm and an additional set of five-time (formative) CBAs were conducted before the final term, so that actual CBA continuance usage of students could be observed. The results show that “self-regulation” significantly moderates the relationship between continuance intention and continuance usage. Additionally, “social influence” is a dominant determinant to continuance intention of using CBA. The proposed model also has high explanatory power. Finally, some implications of practical application and future research are also given.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Alraimi, K.M., Zo, H., Ciganek, A.P.: Understanding the MOOCs continuance: the role of openness and reputation. Comput. Educ. 80, 28–38 (2015)

    Google Scholar 

  2. Attuquayefio, S.N., Addo, H.: Using the UTAUT model to analyze students’ ICT adoption. Int. J. Educ. Dev. Using Inf. Commun. Technol. 10(3), 75–86 (2014)

    Google Scholar 

  3. Bagozzi, R.P., Yi, Y.: On the evaluation of structural equation models. J. Acad. Mark. Sci. 16(1), 74–94 (1988)

    Google Scholar 

  4. Barnard, L., Lan, W., To, Y., Paton, V., Lai, S.: Measuring self-regulation in online and blended learning environments. Internet Higher Educ. 12(1), 1–6 (2009)

    Google Scholar 

  5. Bhattacherjee, A.: Understanding information systems continuance: an expectation-confirmation model. MIS Q. 25(3), 351–370 (2001)

    Google Scholar 

  6. Chin, W.W., Todd, P.A.: On the use, usefulness, and ease of use of structural equation modeling in MIS research. MIS Q. 19, 237–246 (1995)

    Google Scholar 

  7. Chiu, C.M., Hsu, M.H., Sun, S.Y., Lin, T.C., Sun, P.C.: Usability, quality, value and e-learning continuance decisions. Comput. Educ. 45(4), 399–416 (2005)

    Google Scholar 

  8. Chiu, C.M., Sun, S.Y., Sun, P.C., Ju, T.L.: An empirical analysis of the antecedents of web-based learning continuance. Comput. Educ. 49(4), 1224–1245 (2007)

    Google Scholar 

  9. Cohen, J.: Statistical power analysis for the behavioural sciences, 2nd edn. Lawrence Erlbaum, Hillsdale (1998)

    Google Scholar 

  10. Costal, D.S.J., Mullan, B.A., Kothe, E.J., Butow, P.: A web-based formative assessment tool for Masters students: a pilot study. Comput. Educ. 54(4), 1248–1253 (2010)

    Google Scholar 

  11. Dabbagh, N., Kitsantas, A.: Personal learning environments, social media, and self-regulated learning: a natural formula for connecting formal and informal learning. Internet Higher Educ. 15, 3–8 (2012)

    Google Scholar 

  12. Dağhan, G., Akkoyunlu, B.: Modeling the continuance usage intention of online learning environments. Comput. Hum. Behav. 60, 198–211 (2016)

    Google Scholar 

  13. de Oca, A.M.M., Nistor, N.: Non-significant intention–behavior effects in educational technology acceptance: a case of competing cognitive scripts? Comput Hum Behav 34, 333–338 (2014)

    Google Scholar 

  14. Deng, S., Liu, Y., Qi, Y.: An empirical study on determinants of web based question-answer services adoption. Online Inf. Rev. 35(5), 789–798 (2011)

    Google Scholar 

  15. Deutsch, T., Herrmann, K., Frese, T., Sandholzer, H.: Implementing computer-based assessment–a web-based mock examination changes attitudes. Comput. Educ. 58(4), 1068–1075 (2012)

    Google Scholar 

  16. Fornell, C., Larcker, D.F.: Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 18(1), 39–50 (1981)

    Google Scholar 

  17. Hair, J.F., et al.: Multivariate data analysis, 5th edn. Prentice-Hall, Englewood Cliffs (1998)

    Google Scholar 

  18. Jordan, K.: Initial trends in enrolment and completion of massive open online courses. Int. Rev. Res. Open. Distrib. Learn. 15(1), 1 (2014)

    Google Scholar 

  19. Karahanna, E., Straub, D., Chervany, N.: Information technology adoption across time: a cross-sectional comparison of pre adoption and post-adoption beliefs. MIS Q. 23(2), 183–213 (1999)

    Google Scholar 

  20. Lee, M.: Explaining and predicting users’ continuance intention toward e-learning: an extension of the expectation–confirmation model. Comput. Educ. 54(2), 506–516 (2010)

    Google Scholar 

  21. Limayem, M., Cheung, C.M.: Understanding information systems continuance: The case of Internet-based learning technologies. Inf. Manag. 45(4), 227–232 (2008)

    Google Scholar 

  22. Limayem, M., Cheung, C.M.: Predicting the continued use of Internet-based learning technologies: the role of habit. Behav. Inf. Technol. 30(1), 91–99 (2011)

    Google Scholar 

  23. Lin, J.W., Lai, Y.C.: Harnessing collaborative annotations on online formative assessments. Educ. Technol. Soc. 16(1), 263–274 (2013)

    MathSciNet  Google Scholar 

  24. Lin, J.W., Lai, Y.C.: Online formative assessments with social network awareness. Comput. Educ. 66, 40–53 (2013)

    Google Scholar 

  25. Lin, J.W., Huang, H.H., Chuang, Y.S.: The impacts of network centrality and self-regulation on an e-learning environment with the support of social network awareness. Br. J. Edu. Technol. 46(1), 32–44 (2015)

    Google Scholar 

  26. Lin, J.W., Lai, Y.C., Chang, L.C.: Fostering self-regulated learning in a blended environment using group awareness and peer assistance as external scaffolds. J. Comput. Assist. Learn. 32(1), 77–93 (2016)

    Google Scholar 

  27. Lin, J.W., Szu, Y.C., Lai, C.N.: Effects of group awareness and self-regulation level on online learning behaviors. Int. Rev. Res. Open Distrib. Learn. 17(4), 225–241 (2016)

    Google Scholar 

  28. Lin, J.W., Tsai, C.W.: The impact of an online project-based learning environment with group awareness support on students with different self-regulation levels: An extended-period experiment. Comput. Educ. 99, 28–38 (2016)

    Google Scholar 

  29. Lin, J.W., Lin, H.C.: User acceptance in a computer-supported collaborative learning (CSCL) assessment environment with social network awareness (SNA) support. Australas. J. Educ. Technol. 35(1), 100–115 (2019)

    Google Scholar 

  30. Lin, J.W., Lai, Y.C.: User acceptance model of computer-based assessment: moderating effect of self-regulation. Australas. J. Educ. Technol. 35(1), 163–176 (2019)

    Google Scholar 

  31. McManus, T.F.: Individualizing instruction in a web-based hypermedia learning environment: nonlinearity, advance organizers, and self-regulated learners. J. Interact. Learn. Res. 11, 219–251 (2000)

    Google Scholar 

  32. Newman, R.S.: How self-regulated learners cope with academic difficulty: The role of adaptive help seeking. Theory Into Pract. 41(2), 132–138 (2002)

    Google Scholar 

  33. Nikou, S.A., Economides, A.A.: Mobile-based assessment: Investigating the factors that influence behavioral intention to use. Comput. Educ. 109, 56–73 (2017)

    Google Scholar 

  34. Nistor, N.: When technology acceptance models won’t work: non-significant intention-behavior effects. Comput Hum Behav 34, 299–300 (2014)

    Google Scholar 

  35. Nistor, N., Schworm, S., Werner, M.: Online help-seeking in communities of practice: Modeling the acceptance of conceptual artifacts. Comput. Educ. 59(2), 774–784 (2012)

    Google Scholar 

  36. Oliver, R.L.: A cognitive model of the antecedents and consequences of satisfaction decisions. J. Mark. Res. 17, 460–469 (1980)

    Google Scholar 

  37. Pereira, F.A.M., Ramos, A.S.M., Gouvêa, M.A., da Costa, M.F.: Satisfaction and continuous use intention of e-learning service in Brazilian public organizations. Comput. Hum. Behav. 46, 139–148 (2015)

    Google Scholar 

  38. Pintrich, P.R.: A conceptual framework for assessing motivation and self-regulated learning in college students. Educ. Psychol. Rev. 16(4), 358–407 (2004)

    Google Scholar 

  39. Roca, J.C., Chiu, C.M., et al.: Understanding e-learning continuance intention: an extension of the technology acceptance model. Hum.-Comput. Stud. 64(6), 683–696 (2006)

    Google Scholar 

  40. Schunk, D.H.: Self-regulation of self-efficacy and attributions in academic settings. In: Schunk, D.H., Zimmermann, B.J. (eds.) Self-regulation of learning performance: issues and educational applications, 1st edn, pp. 75–99. Lawrence Erlbaum Associates, Hillsday (1994)

    Google Scholar 

  41. Shea, P., Bidjerano, T.: Learning presence as a moderator in the community of inquiry model. Comput. Educ. 59, 326–326 (2012)

    Google Scholar 

  42. Sykes, T.A., Venkatesh, V., Gosain, S.: Model of acceptance with peer support: a social network perspective to understand employees’ system use. MIS Q. 33(2), 371–393 (2009)

    Google Scholar 

  43. Straub, D., Limayem, M., Karahanna-Evaristo, E.: Measuring system usage: implications for IS theory testing. Manag. Sci. 41(8), 1328–1342 (1995)

    Google Scholar 

  44. Talukder, M., Quazi, A.: The impact of social influence on individuals’ adoption of innovation. J. Org. Comput. Electron. Commer. 21(2), 111–135 (2011)

    Google Scholar 

  45. Terzis, V., Economides, A.A.: The acceptance and use of computer based assessment. Comput. Educ. 56(4), 1032–1044 (2011)

    Google Scholar 

  46. Terzis, V., Economides, A.A.: Computer based assessment: Gender differences in perceptions and acceptance. Comput. Hum. Behav. 27(6), 2108–2122 (2011)

    Google Scholar 

  47. Terzis, V., Moridis, C.N., Economides, A.A.: Continuance acceptance of computer based assessment through the integration of user’s expectations and perceptions. Comput. Educ. 62, 50–61 (2013)

    Google Scholar 

  48. Tosuntaş, Ş.B., Karadağ, E., Orhan, S.: The factors affecting acceptance and use of interactive whiteboard within the scope of FATIH project: a structural equation model based on the Unified Theory of acceptance and use of technology. Comput. Educ. 81, 169–178 (2015)

    Google Scholar 

  49. Venkatesh, V., Morris, M.G., Davis, G.B., Davis, F.D.: User acceptance of information technology: toward a unified view. MIS Q. 27(3), 425–478 (2003)

    Google Scholar 

  50. Vercellone-Smith, P., Jablokow, K., Friedel, C.: Characterizing communication networks in a web-based classroom: cognitive styles and linguistic behavior of self-organizing groups in online discussions. Comput. Educ. 59(2), 222–235 (2012)

    Google Scholar 

  51. Wang, T.H.: Developing web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment. Comput. Educ. 57(2), 1801–1812 (2011)

    Google Scholar 

  52. Wu, B., Chen, X.: Continuance intention to use MOOCs: Integrating the technology acceptance model (TAM) and task technology fit (TTF) model. Comput. Hum. Behav. 67, 221–232 (2017)

    Google Scholar 

  53. Yueh, H.P., Huang, J.Y., Chang, C.: Exploring factors affecting students’ continued Wiki use for individual and collaborative learning: An extended UTAUT perspective. Australas. J. Educ. Technol. 31(1), 16–31 (2015)

    Google Scholar 

  54. Zimmerman, B.J.: Attaining self-regulated learning: a social-cognitive perspective. In: Boekaerts, M., Pintrich, P., Zeidner, M. (eds.) Handbook of Self-Regulation, pp. 13–39. Academic Press, San Diego (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian-Wei Lin.

Ethics declarations

Conflict of interest

Additionally, on behalf of all authors, the corresponding author states that there is no conflict of interest.

Ethical approval

This research complies with the Taiwan ethical guidelines. The data were anonymous. All the participants were informed of the research purpose, and this research respects the personal rights.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, JW. Continuance model of formative computer-based assessment (CBA): Considering the effects of self-regulation and social influence. Univ Access Inf Soc 19, 905–918 (2020). https://doi.org/10.1007/s10209-019-00701-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-019-00701-x

Keywords