Abstract
This paper proposes a new playful approach to improve children’s writing skills in primary school. This approach is currently being developed in the Study project (\(^{1}\)Study Project, French Region Auvergne-Rhône-Alpes R&D Booster Program, 2020-2022), that proposes a global learning solution through the use of an innovative interactive device, combining advanced technologies for the writing acquisition (Advanced Magnetic Interaction tech from AMI/ISKN \(^{2}\)(ISKN Repaper Tablet,https://www.iskn.co/fr), and the conception of a gamified environment for children (Super Extra Lab \(^{3}\)(SuperExtraLab, https://www.superextralab.com/) distributed by Extrapage, publisher of the solution) \(^{4}\)(Extrapage, https://www.extrapage.io/fr/pages/index.html) The proposition associates traditional school materials (textbook, paper, pencil...) with very recent technologies and didactic innovations. While the state-of-art is usually satisfied with solutions strictly focusing on lexical spelling, the Study project aims to contribute to a broader control of handwriting skills, i.e., the acquisition of efficient handwriting micro-motor skills and also strong grammatical skills. To achieve this, the approach relies on a personalized, regular and enriched copy and dictation training program. It establishes conditions that encourage children to be involved in an activity that is often unpleasant, and is inspired by the mechanics of video games. In the paper, we present an overview of the project, the construction of the general framework in relation with the design of a game interface for learning and the first recognition results based on a dedicated MDSLTM-CTC trained on a GAN-generated dataset that cover different writing styles.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
tori\(^\mathrm{TM}\), https://www.tori.com/fr/.
- 2.
Extrapage, https://www.extrapage.io/.
- 3.
Microsoft Ink Recognizer API: https://www.iskn.co/fr.
- 4.
Google Cloud Vision: https://cloud.google.com/vision.
- 5.
MyScript: https://www.myscript.com/interactive-ink/.
- 6.
ScoleEdit, http://scoledit.org/scoledition/corpus.php.
References
Bluche, T., Louradour, J., Messina. R.: Scan, attend and read: end-to-end handwritten paragraph recognition with MDLSTM attention. In: Proceedings of the International Conference on Document Analysis and Recognition (ICDAR), vol. 1, pp. 1050–1055 (2017). ISSN:15205363. https://doi.org/10.1109/ICDAR.2017.174
Chorowski, J., Bahdanau, D., Serdyuk, D., Cho, K., Bengio, Y.: Attention-based models for speech recognition. Adv. Neural Inf. Proces. Syst. 2015, 577–585 (2015). ISSN 10495258
Eloi, A., Bastien, M., Ronaldo, M.: Adversarial generation of handwritten text images conditioned on sequences. In: Proceedings of the International Conference on Document Analysis and Recognition (ICDAR), vol. 1, pp. 481–486 (2019). ISSN 15205363. https://doi.org/10.1109/ICDAR.2019.00083
FKI: Research group on computer vision and artificial intelligence — computer vision and artificial intelligence (2002). https://fki.tic.heia-fr.ch/databases/iam-handwriting-database
Graves, A.: Generating Sequences With Recurrent Neural Networks. pp. 1–43 (2013). http://arxiv.org/abs/1308.0850
Graves, A., Fernández, S., Schmidhuber, J.: Multi-dimensional recurrent neural networks. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 4668 LNCS (PART 1), pp. 549–558 (2007). ISSN 16113349. https://doi.org/10.1007/978-3-540-74690-4_56
ISKN: Tablette graphique Repaper: tablette papier crayon originale | iskn, 2020. URL https://www.iskn.co/fr
Jia, Y.: Attention mechanism in machine translation. J. Phys. Conf. Ser: 1314(1), 012186 (2019). ISSN:17426596. https://doi.org/10.1088/1742-6596/1314/1/012186
Kang, L., Riba, P., Rusiñol, M., Fornés, A.: Mauricio villegas. pay attention to what you read: non-recurrent handwritten text-line recognition. arXiv, (2020). ISSN 23318422
Matcha, A.C.N.: How to easily do handwriting recognition using deep learning. (2020). https://nanonets.com/blog/handwritten-character-recognition/
Pham, V., Bluche, T., Kermorvant, C., Louradour, J.: Dropout improves recurrent neural networks for handwriting recognition. In: Proceedings of International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 285–290. December 2014. ISSN 21676453. https://doi.org/10.1109/ICFHR.2014.55
Scheidl, H., Fiel, S., Sablatnig, R.: Word beam search: a connectionist temporal classification decoding algorithm. In: 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR) (2018)
Université Grenoble Alpes. SCOLEDIT - Etat du Corpus (2013). http://scoledit.org/scoledition/corpus.php
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Medjram, S., Eglin, V., Bres, S., Piffaretti, A., Timothée, J. (2021). Playful Interactive Environment for Learning to Spell at Elementary School. In: Barney Smith, E.H., Pal, U. (eds) Document Analysis and Recognition – ICDAR 2021 Workshops. ICDAR 2021. Lecture Notes in Computer Science(), vol 12917. Springer, Cham. https://doi.org/10.1007/978-3-030-86159-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-86159-9_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86158-2
Online ISBN: 978-3-030-86159-9
eBook Packages: Computer ScienceComputer Science (R0)
