Skip to main content
Log in

Machine learning model to predict an adult learner’s decision to continue ESOL course

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

This study investigated the ability of the demographic and the affective variables to predict the adult learners’ decision to continue ESOL courser. 278 adult learners, enrolled on ESOL course at FLS institution in Istanbul, Turkey, participated in the study. The result showed that the continued or dropped out groups, demonstrated statistical differences in the demographic variable (the placement test score) with a magnitude of large effect size (.378). Additionally, the result showed the effect size in the perception of the affective variables (motivation, attitude, and anxiety), accounts for about 50% of the variation between the continuation and dropout groups. Following that, three machine learning models were proposed; all possible subset regression analysis was used to compare the three models. The adequate model, which fitted the demographic variable (the placement test score) and the affective variables (motivation, attitude, and anxiety), correctly predicted 83.3% of the adult learners’ decision to continue ESOL course. The model showed about 68% goodness-of-fit. The cultural implications of these findings are discussed, along with suggestions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Abbreviations

L2:

Second Language

ESOL:

English for speakers of other languages

FLS:

Fatih Language School

AMTB:

Attitude Motivation Test Battery

FLCAS:

Foreign Language Learning Anxiety Scale

ML:

Machine Learning

References

  • Aida, Y. (1994). Examination of Horwitz, Horwitz, and Cope's construct of foreign language anxiety: The case of students of Japanese. The Modern Language Journal, 78(2), 155–168. https://doi.org/10.1111/j.1540-4781.1994.tb02026.x.

    Article  Google Scholar 

  • Bailey, K. M. (1983). Competitiveness and anxiety in adult second language learning: Looking at and through the diary studies. Classroom oriented research in second language acquisition (pp. 67–102). Rowley, MA: Newbury House,

  • Bailey, P., Onwuegbuzie, A. J., & Daley, C. E. (2003). Foreign language anxiety and student attrition. Academic Exchange Quarterly, 7(2), 304–309.

    Google Scholar 

  • Bartley, D. E. (1969). A pilot study of aptitude and attitude; factors in language dropout. California Journal of Educational Research 20, 48–55.

  • Bartley, D. E. (1970). The importance of the attitude factor in language dropout: A preliminary investigation of group and sex differences. Foreign Language Annals, 3(3), 383–393. https://doi.org/10.1111/j.1944-9720.1970.tb01292.x.

    Article  Google Scholar 

  • Berry, W. D., & Feldman, S. (1985). Multiple regression in practice. Thousand Oaks: Sage Publications.

    Book  Google Scholar 

  • Clément, R., & And, O. (1978). Persistence in second-language study: Motivational considerations. Canadian Modern Language Review. Retrieved from https://www.utpjournals.press/loi/cmlr.

  • Cochran, J. L., McCallum, R. S., & Bell, S. M. (2010). Three A’s: How do attributions, attitudes, and aptitude contribute to foreign language learning? Foreign Language Annals, 43(4), 566–582. https://doi.org/10.1111/j.1944-9720.2010.01102.x.

    Article  Google Scholar 

  • Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement, 33(1), 107–112. https://doi.org/10.1177/001316447303300111.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Lawrence Erlbaum.

    MATH  Google Scholar 

  • Cox, D. (1989). Analysis of binary data. New York: Routledge. https://doi.org/10.1201/9781315137391.

  • Crookes, G., & Schmidt, R. W. (1991). Motivation: Reopening the research agenda. Language Learning, 41(4), 469–512. https://doi.org/10.1111/j.1467-1770.1991.tb00690.x.

    Article  Google Scholar 

  • Dörnyei, Z. (2001). Motivational strategies in the language classroom. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Dörnyei, Z. (2003). Attitudes, orientations, and motivations in language learning: Advances in theory, research, and applications. Language Learning, 53(S1), 3–32. https://doi.org/10.1111/1467-9922.53222.

    Article  Google Scholar 

  • Dörnyei, Z., & Murphey, T. (2003). Group dynamics in the language classroom. Cambridge: Cambridge University Press.

  • Ehrman, M. E., & Oxford, R. L. (1995). Cognition plus: Correlates of language learning success. The Modern Language Journal, 79(1), 67–89. https://doi.org/10.1111/j.1540-4781.1995.tb05417.x.

    Article  Google Scholar 

  • Ellis, R. (2004). Individual differences in second language learning (pp. 525–551). Blackwell Publishing Ltd.

  • Gardner, R. C. (1985). Social psychology and second language learning: The role of attitude and motivation. London: Edward Arnold.

    Google Scholar 

  • Gardner, R. C. (1987). The role of anxiety in second language performance of language dropouts. Research Bulletin No. 657.

  • Gardner, R. C. (2004). Attitude/motivation test battery: International AMTB research project. Ontario: The University of Western Ontario.

    Google Scholar 

  • Gardner, R. C. (2008). Individual differences in second and foreign language learning. In Encyclopedia of language and education (pp. 1135–1146). Springer US. https://doi.org/10.1007/978-0-387-30424-3_87.

  • Gardner, R. C., & Lambert, W. E. (1972). Motivational variables in second language acquisition. In R.C. Gardner & W. Lambert (eds.) Attitudes and motivation in second language learning (pp. 119–216). Rowley, Newbury House.

  • Gardner, R. C., & MacIntyre, P. D. (1991). An instrumental motivation in language study: Who says it isn't effective? Studies in Second Language Acquisition, 13(1), 57–72. https://doi.org/10.1017/S0272263100009724.

    Article  Google Scholar 

  • Gardner, R. C., & Smythe, P.C. (1975) Second language acquisition: A social psychological approach. Research Bulletin No. 332.

  • Gibson, H., & Shutt, J. (2002). Tuning in, turning on and dropping out: An investigation into the reasons for non-completion of adult foreign language courses in colleges of FE. Language Learning Journal, 25(1), 59–64.

    Article  Google Scholar 

  • Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis (6th ed.). Pearson Prentice Hall: Upper saddle River.

    Google Scholar 

  • Horwitz, E. K. (1991). Preliminary evidence for the reliability and validity of a foreign language anxiety scale. In E. K. Horwitz & D. J. Young (Eds.), Language anxiety: From theory and research to classroom implications (pp. 37–39). Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Horwitz, E. (2001). Language anxiety and achievement. Annual Review of Applied Linguistics, 21, 112–126. https://doi.org/10.1017/S0267190501000071.

    Article  Google Scholar 

  • Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125–132. https://doi.org/10.1111/j.1540-4781.1986.tb05256.x.

    Article  Google Scholar 

  • Hsieh, F. Y., Bloch, D. A., & Larsen, M. D. (1998). A simple method of sample size calculation for linear and logistic regression. Statistics in Medicine, 17(14), 1623–1634. https://doi.org/10.1002/(SICI)1097-0258(19980730)17:14<1623::AID-SIM871>3.0.CO;2-S.

    Article  Google Scholar 

  • Inbar, O., Donitsa-Schmidt, S., & Shohamy, E. (2001). Students’ motivation as a function of language learning: The teaching of Arabic in Israel. In Motivation and second language acquisition, 23, 297–311. Honolulu: School language Teaching & Curriculum Center.

    Google Scholar 

  • Kotrlik, J. W., & Williams, H. A. (2003). The incorporation of effect size in information technology, learning, and performance research. Information Technology, Learning, and Performance Journal, 21(1), 1–7. Retrieved from https://icproxy.khas.edu.tr:4724/docview/219841023?accountid=16327.

  • Lancaster, H. O., & Seneta, E. (2005). Chi-Square distribution. In encyclopedia of biostatistics. Chichester: John Wiley & Sons, Ltd.. https://doi.org/10.1002/0470011815.b2a15018.

    Google Scholar 

  • Long, J. S. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, CA: Sage.

  • MacIntyre, P. D. (1995). How does anxiety affect second language learning? A reply to Sparks and Ganschow. The Modern Language Journal, 79(1), 90–99. https://doi.org/10.1111/j.1540-4781.1995.tb05418.x.

    Article  Google Scholar 

  • MacKie, S. E. (2001). Jumping the hurdles–undergraduate student withdrawal behaviour. Innovations in Education and Teaching International, 38(3), 265–276.

    Article  Google Scholar 

  • Menard, S. (2000). Coefficients of determination for multiple logistic regression analysis. The American Statistician, 54(1), 17–24.

  • Mertler, C. A., & Vannatta, R. A. (2017). Advanced and multivariate statistical methods : Practical application and interpretation. New York: Routledge.

    Google Scholar 

  • Murphy, K. R., & Myors, B. (1998). Statistical power analysis—A simple and general model for traditional and modern hypothesis tests. New York: Routledge.

    MATH  Google Scholar 

  • Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78(3), 691–692.

  • Onwuegbuzie, A. J., Bailey, P., & Daley, C. E. (2000). Cognitive, affective, personality, and demographic predictors of foreign-language achievement. The Journal of Educational Research, 94(1), 3–15. https://doi.org/10.1080/00220670009598738.

    Article  Google Scholar 

  • Oroujlou, N., & Vahedi, M. (2011). Motivation, attitude, and language learning. Procedia-Social and Behavioral Sciences, 29, 994–1000. https://doi.org/10.1016/J.SBSPRO.2011.11.333.

    Article  Google Scholar 

  • Peng, C. Y. J., Lee, K. L., & Ingersoll, G. M. (2002). An introduction to logistic regression analysis and reporting. The Journal of Educational Research, 96(1), 3–14. https://doi.org/10.1080/00220670209598786.

    Article  Google Scholar 

  • Purcell, S. (2006). Minimising drop-out in adult language classes. Netword, 39, 7.

    Google Scholar 

  • Robinson, P. (2005). Aptitude and second language acquisition. Annual Review of Applied Linguistics, 25, 46–73. https://doi.org/10.1017/S0267190505000036.

    Article  Google Scholar 

  • Schargel, F., & Smink, J. (2014). Strategies to help solve our school dropout problem. New York: Routledge.

  • Skilton-Sylvester, E. (2002). Should I stay or should I go? Investigating Cambodian women’s participation and investment in adult ESL programs. Adult Education Quarterly, 53(1), 9–26.

    Article  Google Scholar 

  • Watt, D., & Roessingh, H. (2001). The dynamics of ESL drop-out: Plus Ça change. Canadian Modern Language Review, 58(2), 203–222. https://doi.org/10.3138/cmlr.58.2.203.

    Article  Google Scholar 

  • Watts, C. (2004). Some reasons for the decline in numbers of MFL students at degree level. Language Learning Journal, 29(1), 59–67.

    Article  Google Scholar 

  • William, M., & Burden, R. (1997). Psychology for language teachers. Cambridge: Cambridge University Press.

    Google Scholar 

Download references

Acknowledgements

This study was supported by Semiha Sünnetci Dahman as the language editor and personal motivator. Ms. Havva Emre as the language translator. G. Tarcan KUMKALE, PhD and Prof Dr. Mustafa BAĞRIYANIK as committee advisors.

Author information

Authors and Affiliations

Authors

Contributions

Corresponding author was responsible for the experimental work and paper authoring. co-author was responsible for setting the framework for the study, as well as supervising the research process.

Corresponding author

Correspondence to Mohammed R. Dahman.

Ethics declarations

Declaration of interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dahman, M.R., Dağ, H. Machine learning model to predict an adult learner’s decision to continue ESOL course. Educ Inf Technol 24, 2429–2452 (2019). https://doi.org/10.1007/s10639-019-09884-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-019-09884-5

Keywords

Navigation