Abstract
New media literacy is an expected competency for university students. However, few literacy scales can evaluate students' fake news reporting and checking abilities. In the past, the new media literacy framework only included Critical Consuming, Critical Prosumption, Functional Prosumption, and Functional Consuming. Therefore, this study proposes a self-assessable new online media and reporting literacy scale (NOMRL) based on the previous new media literacy framework. The NOMRL scale was developed in four phases. A literature review generated a pool of items in the first phase. Phase 2 was conducted through an expert review to confirm the validity of the content. Phase 3 was the purification of the scale in Study 1, where 243 university students participated in this survey phase. Finally, we analyzed 365 university students' responses in Study 2 and derived a factor structure using EFA while conducting a reliability assessment with CFA to test the theoretical structure. This study resulted in a 22-item scale, including two new constructs: Behavioral Consumption and Behavioral Prosumption. The scale can help college students self-assess their level of reporting-related literacy in social media. In addition to discussing the educational implications, this paper provides insights and suggestions for future research.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Data sharing is not applicable to this article as no new data were created or analyzed in this study.
References
Apps, T., Agostinho, S., & Bennett, S. (2022). ‘Maybe it’s the environment you grow up in?’Australian primary school students’ reflections on their school-based digital literacy. Technology, Pedagogy and Education, 31(2), 231–246.
BBCNEWS. (2020). From students to politicians, many smart people have fallen for dangerous lies spread about the new coronavirus. Why? And how can you protect yourself from misinformation? https://www.bbc.com/future/article/20200406-why-smart-people-believe-coronavirus-myths. Accessed 26 March 2023.
Celik, I., Muukkonen, H., & Dogan, S. (2021). A model for understanding new media literacy: Epistemological beliefs and social media use. Library & Information Science Research, 43(4), 101125.
Chen, D.-T., Lin, T.-B., Li, J.-Y., & Lee, L. (2018). Establishing the norm of new media literacy of Singaporean students: Implications to policy and pedagogy. Computers & Education, 124, 1–13. https://doi.org/10.1016/j.compedu.2018.04.010.
Chen, D.-T., Wu, J., & Wang, Y.-M. (2011). Unpacking new media literacy. Journal of Systemics, Cybernetics and Informatics, 9(2), 84–88. http://www.iiisci.org/journal/sci/FullText.asp?var=&id=OL508KR.
Child, D. (2006). The essentials of factor analysis. A&C Black.
Dame Adjin-Tettey, T. (2022). Combating fake news, disinformation, and misinformation: Experimental evidence for media literacy education. Cogent Arts & Humanities, 9(1), 2037229.
Dumitru, EA., Ivan, L., Loos, E. (2022). A Generational Approach to Fight Fake News: In Search of Effective Media Literacy Training and Interventions. In: Gao, Q., Zhou, J. (eds) Human Aspects of IT for the Aged Population. Design, Interaction and Technology Acceptance. HCII 2022. Lecture Notes in Computer Science, vol 13330. Springer, Cham. https://doi.org/10.1007/978-3-031-05581-2_22.
Eristi, B., & Erdem, C. (2017). Development of a media literacy skills scale. Contemporary Educational Technology, 8(3), 249–267.
Gorsuch, R. L. (1983). Factor Analysis. Lawrence Earlbaum Associates. In: Inc.
Guess, A., Nagler, J., & Tucker, J. (2019). Less than you think: Prevalence and predictors of fake news dissemination on Facebook. Science Advances, 5(1). https://doi.org/10.1126/sciadv.aau4586.
Hauben, M., Hung, E., & Hsieh, W.-Y. (2017). An exploratory factor analysis of the spontaneous reporting of severe cutaneous adverse reactions. Therapeutic Advances in Drug Safety, 8(1), 4–16.
Jones-Jang, S. M., Mortensen, T., & Liu, J. (2021). Does media literacy help identification of fake news? Information literacy helps, but other literacies don’t. American Behavioral Scientist, 65(2), 371–388.
Keil, M., & Park, C. (2010). Bad news reporting on troubled IT projects: Reassessing the mediating role of responsibility in the basic whistleblowing model. Journal of Systems and Software, 83(11), 2305–2316. https://doi.org/10.1016/j.jss.2010.07.009.
Koc, M., & Barut, E. (2016). Development and validation of New Media Literacy Scale (NMLS) for university students. Computers in Human Behavior, 63, 834–843. https://doi.org/10.1016/j.chb.2016.06.035
Ku, K. Y. L., Kong, Q., Song, Y., Deng, L., Kang, Y., & Hu, A. (2019). What predicts adolescents’ critical thinking about real-life news? The roles of social media news consumption and news media literacy. Thinking Skills and Creativity, 33, 100570. https://doi.org/10.1016/j.tsc.2019.05.004.
Lee, L., Chen, D.-T., Li, J.-Y., & Lin, T.-B. (2015). Understanding new media literacy: The development of a measuring instrument. Computers & Education, 85, 84–93. https://doi.org/10.1016/j.compedu.2015.02.006.
Liao, C. H., Chiang, C.-T., Chen, I. C., & Parker, K. R. (2022). Exploring the relationship between computational thinking and learning satisfaction for non-STEM college students. International Journal of Educational Technology in Higher Education, 19(1), 43. https://doi.org/10.1186/s41239-022-00347-5
Lin, T.-B., Li, J.-Y., Deng, F., & Lee, L. (2013). Understanding new media literacy: An explorative theoretical framework. Journal of Educational Technology & Society, 16(4), 160–170.
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing research. 35(6), 382–386.
McHugh, M., McCauley, V., Davison, K., Raine, R., & Grehan, A. (2020). Anchoring ocean literacy: Participatory iBook design within secondary science classrooms. Technology, Pedagogy and Education, 29(1), 89–107.
Meel, P., & Vishwakarma, D. K. (2020). Fake news, rumor, information pollution in social media and web: A contemporary survey of state-of-the-arts, challenges and opportunities [Review]. Expert Systems with Applications, 153, 26, Article 112986. https://doi.org/10.1016/j.eswa.2019.112986.
Mohd Zeamlee, S. N., Ali, M. M., & Hasnan, S. (2022). Perceptions of Moral Intensity and Professional Commitment Towards Intention to Whistleblowing: Empirical Evidence from Malaysian Public Sector Organisations. The Journal of Asian Finance, Economics and Business, 9(6), 53-67.
Owusu, G. M. Y., Bekoe, R. A., Anokye, F. K., & Okoe, F. O. (2020). Whistleblowing intentions of accounting students: An application of the theory of planned behaviour. Journal of Financial Crime. 27(2), 477–492.
Oyewunmi, A. E., & Oyewunmi, O. A. (2022). Speaking Silence: Abusive Supervision, Subordinates’ Citizenship Behavior, and Whistleblowing Intention. SAGE Open, 12(1), 21582440221079910.
Price, C. J. (2008). Job Satisfaction in Network News: The Relationship between Producers and the News Reporters and Newsmagazine Correspondents They Supervise. Electronic News, 2(2), 72–85. https://doi.org/10.1080/19312430802003618
Ratnasari, Y. (2020). Effect of professionalism and social aspects of students on whistleblowing intentions. PalArch’s Journal of Archaeology of Egypt/egyptology, 17(3), 2080–2088.
Shahbazi, M., Farajpahlou, A., Osareh, F., & Rahimi, A. (2019). Development of a scale for data quality assessment in automated library systems. Library & Information Science Research, 41(1), 78–84. https://doi.org/10.1016/j.lisr.2019.02.005.
Syam, H. M., & Nurrahmi, F. (2020). "I Don't Know If It Is Fake or Real News" How Little Indonesian University Students Understand Social Media Literacy. Jurnal Komunikasi-Malaysian Journal of Communication, 36(2), 92–105. https://doi.org/10.17576/JKMJC-2020-3602-06.
Tavşancil, E. (2002). Tutumların ölçülmesi ve SPSS ile veri analizi. Nobel Yayıncılık, Ankara.
Valentine, S., & Godkin, L. (2019). Moral intensity, ethical decision making, and whistleblowing intention. Journal of Business Research, 98, 277–288. https://doi.org/10.1016/j.jbusres.2019.01.009.
Zakariaa, M., Rosnidahb, I., Saric, E. N., & Azella, N. (2020). Predicting internal and external whistleblowing intentions: A comparative study between Malaysian and Indonesian police forces. International Journal of Innovation, Creativity and Change, 13(7), 44–66.
Acknowledgements
This study is based on the third author’s master's thesis, and it was conducted under the project number MOST 110-2511-H-025 -002 -MY2 at the National Science and Technology Council in Taiwan.
Funding
This study was supported by the National Science and Technology Council, Taiwan, under contract numbers MOST 110–2511-H-025 -002 -MY2.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hsiao, KL., Ku, YY. & Lee, YT. Development and validation of a scale for assessing university students' new online media and reporting literacy. Educ Inf Technol 28, 13569–13594 (2023). https://doi.org/10.1007/s10639-023-11730-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11730-8