skip to main content
10.1145/3510309.3510336acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicetmConference Proceedingsconference-collections
research-article

Investigating Digital Literacy Skills in Examination-Oriented Education System for the Post-Pandemic Era

Published: 14 March 2022 Publication History

Abstract

Digital Literacy has become a pressing capability because of the infusion of digital technology in education systems due to the changes brought by COVID-19. Whether a student possesses digital literacy skills that are essential for online learning can be especially significant in an examination-oriented education system. In this qualitative study, we aimed to use the Digital Literacy Global Framework as our theoretical reference to 1) identify the digital literacy skills that students demonstrate in online exams, and 2) investigate their consistency in applying the identified skills. We utilized convenience sampling strategy to collect our data from a Hong Kong secondary school and we used content analysis to analyze our data. The validity and reliability of our data analysis were ensured by high intercoder agreement rates and Cohen's Kappa statistics. We found ten digital literacy skills of basic operation of devices and software that students demonstrate. In addition, some identified digital literacy skills are applied more consistently by students than other identified digital literacy skills. We discussed the findings in the context of implications to help researchers and professionals identify and assess essential digital literacy skills for online assessments. Suggestions for future studies were also made in the conclusions.

References

[1]
Feijoo, C., Fernández, J., Arenal, A., Armuña, C. and Ramos, S. (2021). Educational technologies in China, Publications Office of the European Union, Luxembourg. Retrieved from: https://op.europa.eu/en/publication-detail/-/publication/d84565fd-91ca-11eb-b85c-01aa75ed71a1/language-en.
[2]
Madaus, G., & Russell, M. (2010). Paradoxes of High-Stakes Testing. Journal of Education, 190(1–2), 21–30. https://doi.org/10.1177/0022057410190001-205.
[3]
Chamberlain, L., Lacina, J., Bintz, W. P., Jimerson, J. B., Payne, K., & Zingale, R. (2020). Literacy in Lockdown: Learning and Teaching During COVID‐19 School Closures. The Reading Teacher, 74(3), 243–253. https://doi.org/10.1002/trtr.1961
[4]
Kominers, S., & Gonzalez, G. (2020, November 20). Zoom Video Communications and COVID-19. Harvard Business School Case, 820-108.
[5]
Lowenthal R.P., Borup J., West E. R. & Archambault L. (2020). Thinking Beyond Zoom: Using Asynchronous Video to Maintain Connection and Engagement During the COVID-19 Pandemic. Journal of Technology and Teacher Education, 28(2),383-391.
[6]
Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018.
[7]
Gilster, P. (1997), Digital literacy. New York: Wiley Computer Publications.
[8]
Law, N., Woo, D., de la Torre, J., & Wong, G. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4.2 (Information Paper, p. 146). UNESCO Institute for Statistics.
[9]
ÖNcül, G. (2020). Defining the need: digital literacy skills for first-year university students. Journal of Applied Research in Higher Education, ahead-of(ahead-of-print). https://doi.org/10.1108/jarhe-06-2020-0179.
[10]
Vuorikari, R., Punie, Y., Carretero, S., & Van den Brande, L. (2016). DigComp 2.0: The Digital Competence Framework for Citizens Update Phase 1: The Conceptual Reference Model. Joint Research Centre (JRC).
[11]
DigComp 2.0: The Digital Competence Framework for Citizens (p.8-9): https://publications.jrc.ec.europa.eu/repository/handle/JRC101254.
[12]
A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4.2 (p.23-25): http://uis.unesco.org/sites/default/files/documents/ip51-global-framework-reference-digital-literacy-skills-2018-en.pdf.
[13]
Zhao, Y., Pinto Llorente, A. M., & Sánchez Gómez, M. C. (2021). Digital competence in higher education research: A systematic literature review. Computers & Education, 168, 104212. https://doi.org/10.1016/j.compedu.2021.104212.
[14]
Phuapan, P., Viriyavejakul, C., & Pimdee, P. (2016). An analysis of digital literacy skills among Thai university seniors. International Journal of Emerging Technologies in Learning (iJET), 11(03), 24. https://
[15]
Burns M. (2011). Distance Education for Teacher Training: Modes, Models, and Methods. Education Development Center (EDC), Inc, Massachusetts, 10-28.
[16]
Jacobs, G., Castek, J., Pizzolato, D., Pendell, K., Withers, E., & Reder, S. (2015). Executive Summary: Tutor-facilitated digital literacy acquisition in hard-to-serve populations, a research project. Retrieved from: https://pdxscholar.library.pdx.edu/digital_literacy_acquisition_findings/9/.
[17]
Creswell, J. W. (2021). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.). SAGE Publications, Inc.
[18]
Etikan, I. (2016). Comparison of Convenience Sampling and Purposive Sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1. https://doi.org/10.11648/j.ajtas.20160501.11.
[19]
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research. Administration and policy in mental health, 42(5), 533–544.
[20]
School Information: https://dse.bigexam.hk/en/ssp/school/42.
[21]
Hsieh, H.-F., & Shannon, S. E. (2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research, 15(9), 1277–1288.
[22]
DeCuir-Gunby, J. T., Marshall, P. L., & McCulloch, A. W. (2011). Developing and Using a Codebook for the Analysis of Interview Data: An Example from a Professional Development Research Project. Field Methods, 23(2), 136–155. https://doi.org/10.1177/1525822X10388468.
[23]
Saldaña, J. (2015). The Coding Manual for Qualitative Researchers (3rd ed.). 157-163. SAGE Publications Ltd.
[24]
Saldaña, J. (2015). The Coding Manual for Qualitative Researchers (3rd ed.). 72-77. SAGE Publications Ltd.
[25]
Campbell, J. L., Quincy, C., Osserman, J., & Pedersen, O. K. (2013). Coding In-depth Semistructured Interviews. Sociological Methods & Research, 42(3), 294–320. https://doi.org/10.1177/0049124113500475.
[26]
Burla, L., Knierim, B., Barth, J., Liewald, K., Duetz, M., & Abel, T. (2008). From Text to Codings: Intercoder Reliability Assessment in Qualitative Content Analysis. Nursing Research, 57(2), 113–117. https://doi.org/10.1097/01.nnr.0000313482.33917.7d.
[27]
Guillén-Gámez, F. D., & Mayorga-Fernández, M. J. (2020). Quantitative-comparative research on digital competence in students, graduates and professors of faculty education: an analysis with ANOVA. Education and Information Technologies, 25(5), 4157–4174. https://doi.org/10.1007/s10639-020-10160-0.
[28]
Kaeophanuek, S., Jaitip, N., & Nilsook, P. (2018). How to Enhance Digital Literacy Skills among Information Sciences Students. International Journal of Information and Education Technology, 8, 292-297.
[29]
Woo, D. J., & Law, N. W. Y. (2021). A Methodology for Deploying a Digital Literacy Framework for Diverse Socioeconomic and Sector Contexts. In ICT and International Learning Ecologies. Routledge.

Cited By

View all
  • (2023)Design and application of an intelligent communication platform for aesthetics education for internationalizationApplied Mathematics and Nonlinear Sciences10.2478/amns.2023.1.003539:1Online publication date: 6-Jun-2023

Index Terms

  1. Investigating Digital Literacy Skills in Examination-Oriented Education System for the Post-Pandemic Era
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICETM '21: Proceedings of the 2021 4th International Conference on Education Technology Management
        December 2021
        323 pages
        ISBN:9781450385800
        DOI:10.1145/3510309
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 March 2022

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. COVID-19
        2. China
        3. Digital Competences
        4. Digital Literacy
        5. Digital Literacy Skills
        6. Examination-Oriented Education System
        7. Hong Kong
        8. Online Learning & Assessment
        9. Post-Pandemic

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ICETM'21

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)26
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 28 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Design and application of an intelligent communication platform for aesthetics education for internationalizationApplied Mathematics and Nonlinear Sciences10.2478/amns.2023.1.003539:1Online publication date: 6-Jun-2023

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media