Abstract
International studies indicate that the use of smart mobile devices and their accompanying educational applications (apps) can revolutionize young children’s learning experiences. Although there is a vast array of educational apps for preschoolers, they are not actually educational in their majority. In this context, it is important for preschool teachers to be able to assess each app for its effectiveness in educational practice. To evaluate educational mobile apps, this paper presents a rubric (abbreviated as REVEAC) in four areas: contents, design, functionality, and technical quality, each having multiple aspects. In this paper, we discuss the known problems in using educational apps and we present a review of relevant literature, as well as the process of formulating REVEAC. Finally, the paper concludes with a brief discussion of REVEAC limitations and future work.

Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
In this paper the term preschool education is used to refer to the first formal pre-primary educational stage for children 4 to 6 years of age.
References
Allen, D., & Tanner, K. (2006). Rubrics: tools for making learning goals and evaluation criteria explicit for both teachers and learners. CBE-Life Sciences Education, 5(3), 197–203.
Apple (2016). iPad in Education. http://www.apple.com/education/apps-books-and-more/. Accessed 25 Oct 2016.
Avtar, T. (2014). How app markets are adding a lot of value in education, think tab blogs. http://goo.gl/D1gCMp. Accessed 17 Oct 2016.
Bentrop, S. M. (2014). Creating an educational app rubric for teachers of students who are deaf and hard of hearing. Independent Studies and Capstones. Paper 680. Program in Audiology and Communication Sciences, Washington University School of Medicine. http://digitalcommons.wustl.edu/pacs_capstones/680. Accessed 28 Sept 2016.
Big Ideas Machine. (2015). 2015 App reviewer survey. http://bigideasmachine.com/app-reviewer-survey/. Accessed 19 Oct 2016.
Bouck, E. C., Satsangi, R., & Flanagan, S. (2016). Focus on inclusive education: evaluating apps for students with disabilities: supporting academic access and success. Childhood Education, 92(4), 324–328.
Buckler, T. (2012). Is there an app for that? Developing an evaluation rubric for apps for use with adults with special needs? The Journal of BSN Honors Research, 5(1), 19–32.
Cardenal, F., & Lopez, V. (2015). Education apps. One step beyond: it is time for something more in the education apps word. In Á. Herrero, B. Baruque, J. Sedano, H. Quintián, & E. Corchado (Eds.), International Joint Conference: CISIS’15 and ICEUTE’15 (pp. 571–581). Spain: Burgos.
Chau, C. L. (2014). Positive technological development for young children in the context of Children’s mobile apps. In Doctoral dissertation. USA: Tufts University.
Chiong, C. (2012). Living up to the hype: can mobile technology really make kids smarter? Early Childhood Matters, 117, 90–95.
Chiong, C., & Shuler, C. (2010). Learning: is there an app for that? Investigations of young children’s usage and learning with mobile devices and apps. New York: The Joan Ganz Cooney Center at Sesame Workshop.
Cooper, R. J. (2012). Hi ConnSENSE fans! RJ Cooper here. ConnSENSE Bulletin. Retrieved from http://www.connsensebulletin.com/2012/09/hi-connsense-fans-rj-cooper-here/. Accessed 25 Oct 2016.
Ebbeck, M., Yim, H. Y. B., Chan, Y., & Goh, M. (2016). Singaporean parents’ views of their young children’s access and use of technological devices. Early Childhood Education Journal, 44(2), 127–134.
Emeeyou. (2012). Should parents expect more? Making the case for evidence-based early childhood education mobile applications. http://goo.gl/WwBR25. Accessed 11 Oct 2016.
Falloon, G. (2013). Young students using iPads: app design and content influences on their learning pathways. Computers & Education, 68, 505–521.
Falloon, G., & Khoo, E. (2014). Exploring young students’ talk in iPad-supported collaborative learning environments. Computers & Education, 77, 13–28.
Flewitt, R., Messer, D., & Kucirkova, N. (2014). New directions for early literacy in a digital age: the iPad. Journal of Early Childhood Literacy, 15(3), 289–310.
Fu, F., Su, R., & Yu, S. (2009). EGameFlow: a scale to measure learners’ enjoyment of e-learning games. Computers & Education, 52(1), 101–112.
Geisert, P. G., & Futrell, M. K. (1995). Teachers, computers, and curriculum. Boston: Allyn & Bacon.
Guernsey, L., Levine, M., Chiong, C., & Severns, M. (2012). Pioneering literacy in the digital wild west: empowering parents and educators. Washington, DC: Campaign for Grade-Level Reading.
Harrold, R. (2012). The ipad effect: leveraging engagement, collaboration, and perseverance. http://www.tieonline.com/article/100/the-ipad-effect-leveraging-engagement-collaboration-and-perseverance. Accessed 14 Sept 2016.
Haugland, S. W. (1999). Developmental software scale. Cape Girardeau: K.I.D.S. & Computers, Inc..
Higgins, K., Boone, R., & Pierce, T. B. (2005). Evaluating software for use by students with disabilities to foster inclusion in general education. Paper presented at the inclusive and supportive education congress international special education conference. http://goo.gl/TKPGiF. Accessed 14 Sept 2016.
Hirsh-Pasek, K., Zosh, J. M., Golinkoff, R. M., Gray, J. H., Robb, M. B., & Kaufman, J. (2015). Putting education in “educational” apps. Lessons from the science of learning. Psychological Science in the Public Interest, 16(1), 3–34.
Huber, B., Tarasuik, J., Antoniou, M. N., Garrett, C., Bowe, S. J., Kaufman, J., & Team, T. S. B. (2016). Young children’s transfer of learning from a touchscreen device. Computers in Human Behavior, 56, 56–64.
Hutchison, A., Beschorner, B., & Schmidt-Crawford, D. (2012). Exploring the use of the iPad for literacy learning. The Reading Teacher, 66(1), 15–23.
Kluver, C. (2016a). Have children’s apps lost their luster? http://goo.gl/QuMRGJ. Accessed 24 Oct 2016.
Kluver, C. (2016b). What’s the state of the app economy? An Interview with Sarah Towle. http://goo.gl/9zcVFl. Accessed 19 Oct 2016.
Kucirkova, N. (2014a). At what age should we put babies on a digital media diet? https://goo.gl/DqhO7Q. Accessed 22 Oct 2016.
Kucirkova, N. (2014b). How to choose the best educational app for your child. https://goo.gl/cf67ey. Accessed 11 Oct 2016.
Kucirkova, N. (2014c). iPads in early education: separating assumptions and evidence. Frontiers in Psychology, 5, 715.
Kucirkova, N. (2015). Story-making with iPad apps: baking stories in the twenty-first century. Exchange, 222, 47–50.
Kucirkova, N. (2016a). Parents express concerns as more toddlers switch on tablet computers. https://goo.gl/h9GMmJ. Accessed 24 Oct 2016.
Kucirkova, N. (2016b). iRPD—A framework for guiding design-based research for iPad apps. British Journal of Educational Technology. doi:10.1111/bjet.12389.
Kucirkova, N., Messer, D., Sheehy, K., & Panadero, C. F. (2014). Children’s engagement with educational iPad apps: insights from a Spanish classroom. Computers & Education, 71, 175–184.
Landers, R. N. (2015). Computing intraclass correlations (ICC) as estimates of interrater reliability in SPSS. NeoAcademic: Technology, education and training research from an industrial/organizational (I/O) psychologist in the ivory tower. http://neoacademic.com/2011/11/16/computing-intraclass-correlations-icc-asestimates-of-interrater-relaibility-in-spss. Accessed 2 Oct 2016.
Lee, C.-Y., & Cherner, T. S. (2015). A comprehensive evaluation rubric for assessing instructional apps. Journal of Information Technology Education: Research, 14, 21–53.
Lynch, J., & Redpath, T. (2012). ‘smart’ technologies in early years literacy education: a meta-narrative of paradigmatic tensions in iPad use in an Australian preparatory classroom. Journal of Early Childhood Literacy, 14(2), 1–28.
McManis, L. D., & Parks, J. (2011). Evaluating Technology for Early Learners. Ebook and toolkit. Winston-Salem: Hatch Early Learning.
More, C. M., & Travers, J. C. (2013). What’s app with that? Selecting educational apps for young children with disabilities. Young Exceptional Children, 16(2), 15–32.
Moskal, B. M. (2000). Scoring rubrics: what, when and how? Practical Assessment, Research & Evaluation, 7(3), 1–5.
NAEYC & Fred Rogers Center for Early Learning and Children’s Media. (2012). Technology and interactive media as tools in early childhood programs serving children from birth through age 8. In Joint position statement. Washington, DC: NAEYC.
Ok, M. W., Kim, M. K., Kang, E. Y., & Bryant, B. R. (2015). How to find good apps: an evaluation rubric for instructional apps for teaching students with learning disabilities. Intervention in School and Clinic, 51(4), 244–252.
Papadakis, S., & Kalogiannakis, M. (2010). eTwinning in the early childhood as starting line of innovative practices for the didactic of natural sciences. In M. Kalogiannakis, D. Stavrou, & P. G. Michaelides (Eds.), HSci 2010: 7th international conference hands-on science “Bridging the Science and Society Gap” . Greece: University of Crete.July 25–31, 2010
Papadakis, S., & Kalogiannakis, M. (2017). Mobile educational applications for children. What educators and parents need to know. International Journal of Mobile Learning and Organisation (Special Issue on Mobile Learning Applications and Strategies), (in press).
Papadakis, S., Kalogiannakis, M., & Zaranis, N. (2016a). Comparing tablets and PCs in teaching mathematics: an attempt to improve mathematics competence in early childhood education. Preschool and Primary Education, 4(2), 241–253.
Papadakis, S., Kalogiannakis, M., & Zaranis, N. (2016b). Developing fundamental programming concepts and computational thinking with ScratchJr in preschool education: a case study. International Journal of Mobile Learning and Organisation, 10(3), 187–202.
Papadakis, S., Kalogiannakis, M., & Zaranis, N. (2016c). Improving mathematics teaching in kindergarten with realistic mathematical education. Early Childhood Education Journal. doi:10.1007/s10643-015-0768-4.
Parette, H. P., Quesenberry, A. C., & Blum, C. (2010). Missing the boat with technology usage in early childhood settings: a twenty-first century view of developmentally appropriate practice. Early Childhood Education Journal, 37(5), 335–343.
PRWeb. (2012). The YogiMeter. .http://goo.gl/CuYP6f. Accessed 12 Oct 2016
Reeves, T. C., & Harmon, S. W. (1994). Systematic evaluation procedures for interactive multimedia for education and training. In S. Reisman (Ed.), Multimedia computing: preparing for the twenty-first century (pp. 472–505). Harrisburg: Idea Group Publishing.
Richter, F. (2015). Apple'’s App Store Is Growing by 1,000+ Apps a Day. https://goo.gl/pMQImo. Accessed 22 Oct 2016.
Roblyer, M. D., & Wiencke, W. R. (2003). Design and use of a rubric to assess and encourage interactive qualities in distance courses. The American Journal of Distance Education, 17(2), 77–98.
Rodríguez-Arancón P., Arús, J., & Calle, C. (2013). The use of current mobile learning applications in EFL. In Proceedings of the 13th International Educational Technology Conference -IETC 2013, (pp. 1219–1232). Kuala Lumpur, Malaysia
Sesame Workshop (2012). Best Practices: Designing Touch Tablet Experiences for Preschoolers. http://www.sesameworkshop.org/our-blog/2012/12/17/sesames-best-practicesguide-for-childrens-app-development/. Accessed 14 Oct 2016.
Sharples, M., & Beale, R. (2002). Design guide for developers of educational software. Report produced for BECTA. http://www.becta.org.uk/technology/software/curriculum/reports_pdf/designguide.pdf. Accessed 2 Oct 2016.
Shoukry, L., Sturm, C., & Galal-Edeen, G. H. (2012). Pre-MEGa: a proposed framework for the design and evaluation of preschoolers’ mobile educational games. In In the proceedings of The International Conference on Engineering Education, Instructional Technology, Assessment, and E-learning (EIAE 12). Bridgeport: USA.
Shoukry, L., Sturm, C., Galal-Edeen, G. H., & Göbel, S. (2014). Conducting evaluation studies of mobile games with preschoolers. CEUR Workshop Proceedings, 1227, 262–269.
Shrout, P., & Fleiss, J. (1979). Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.
Shuler, C. (2009a). iLearn: a content analysis of the iTunes app Store’s education section. New York: The Joan Ganz Cooney Center at Sesame Workshop.
Shuler, C. (2009b). Pockets of potential: using mobile technologies to promote children’s learning. New York: The Joan Ganz Cooney Center at Sesame Workshop.
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015). Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth, 3(1), e27.
Taggart, G. L., Phifer, S. J., Nixon, J. A., & Wood, M. (Eds.). (1999). Rubrics: a handbook for construction and use. Lanham, MD: Scarecrow Press.
Tammaro, M. T., & Jerome, M. K. (2012). Does the app fit? Using the apps consideration checklist. In M. J. Ault & M. E. Bausch (Eds.), Apps for all students: a teacher’s desktop guide (pp. 23–31). Reston: Exceptional Innovations.
Vaala, S., Ly, A., & Levine, M. H. (2015). Getting a read on the app stores: a market scan and analysis of children’s literacy apps. New York: The Joan Ganz Cooney Center at Sesame Workshop.
Vincent, T. (2012). Ways to evaluate educational apps. http://learninginhand.com/blog/ways-to-evaluate-educational-apps.html. Accessed 14 Oct 2016.
Walker, H. (2010). Evaluating the effectiveness of apps for mobile devices. Journal of Special Education Technology, 26(4), 59–63.
Wartella, E. (2015). Educational apps what We do and do not know. Psychological Science in the Public Interest, 16(1), 1–2.
Watlington, D. (2011). Using iPod touch and iPad educational apps in the classroom. In M. Koehler & P. Mishra (Eds.), Proceedings of Society for Information Technology & teacher education international conference 2011 (pp. 3112–3114). Chesapeake: AACE.
Weng, P.-L., & Taber-Doughty, T. (2015). Developing an app evaluation rubric for practitioners in special education. Journal of Special Education Technology, 30(1), 43–58.
Wikipedia (2016). Mobile app. https://en.wikipedia.org/wiki/Mobile_app. Accessed 7 Oct 2016.
Zaranis, N., Kalogiannakis, M., & Papadakis, S. (2013). Using Mobile Devices for Teaching Realistic Mathematics in Kindergarten Education. Creative Education, 4(7Α1), 1–10.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
None declared.
Appendix 1
Appendix 1
Rights and permissions
About this article
Cite this article
Papadakis, S., Kalogiannakis, M. & Zaranis, N. Designing and creating an educational app rubric for preschool teachers. Educ Inf Technol 22, 3147–3165 (2017). https://doi.org/10.1007/s10639-017-9579-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-017-9579-0