Skip to main content

Advertisement

SpringerLink
Log in

Gestures and marker based low-cost interactive writing board for primary education

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Provision of information simply and interactively has a vital role in any stage of the teaching-learning process especially at primary level, not only guarantees self-motivation of the students but also improves their learning and performance. Virtual and Augmented reality techniques are the most attractive candidates in this regard, render synthetic information, and allow realistic interaction. This paper proposes a low-cost interactive writing board for the teaching of Urdu alphabets in primary education. The proposed writing board allows visualization and interaction of all alphabets, 3D models, and other information realistically and simply. Interaction with writing board is made using: 1) simple mid-air hand gestures and 2) a new touchpad like multi-layered marker. Leap Motion sensor is used for gesture recognition while ARToolKit is used for marker recognition. Experimental results showed that the proposed system has significant improvement in student’s motivation and learning skills. System Usability Scale (SUS) was used to measure usability of the system. The results found gesture-based interaction with high usability, learnability, and more user friendly while the marker with less physical fatigue. A comparison of the proposed writing board with state-of-the-art writing boards resulted in realistic visualization of information (audio, text, and 3D models) and natural interaction of the proposed writing board.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ahsan A, Najam S, Ahmed J, Najam Z (2016) Interactive white board using gestures with kinect. In: 2016 International conference on electrical, electronics, and optimization techniques (ICEEOT). IEEE, pp 90–95

  2. Amma C, Georgi M, Schultz T (2014) Airwriting: a wearable handwriting recognition system. Pers Ubiquitous Comput 18(1):191–203

    Article  Google Scholar 

  3. ARToolKit Documentation (2011). http://www.hitl.washington.edu/artoolkit/documentation/

  4. Bassily D, Georgoulas C, Guettler J, Linner T, Bock T (2014) Intuitive and adaptive robotic arm manipulation using the leap motion controller. In: ISR/Robotik 2014; 41st international symposium on robotics. VDE, pp 1–7

  5. Bested M, Weisberg A H, Durão F A (2017) A social interactive whiteboard system using finger-tracking for mobile devices. Multimed Tools Appl 76 (4):5367–5397

    Article  Google Scholar 

  6. Bhalla M R, Bhalla A V (2010) Comparative study of various touchscreen technologies. Int J Comput Appl 6(8):12–18

    Google Scholar 

  7. Blaha J, Gupta M (2014) Diplopia: a virtual reality game designed to help amblyopics. In: 2014 IEEE virtual reality (VR). IEEE, pp 163–164

  8. Brooke J et al (1996) Sus-a quick and dirty usability scale. Usability Eval Ind 189(194):4–7

    Google Scholar 

  9. Chen M, AlRegib G, Juang B -H (2015) Air-writing recognition—part i: modeling and recognition of characters, words, and connecting motions. IEEE Trans Hum-Mach Syst 46(3):403–413

    Article  Google Scholar 

  10. Chien Y -H (2019) Technology-enhanced learning: an optimal cps learning application. Sustainability 11(16):4415

    Article  Google Scholar 

  11. Donalek C, Djorgovski S G, Cioc A, Wang A, Zhang J, Lawler E, Yeh S, Mahabal A, Graham M, Drake A et al (2014) Immersive and collaborative data visualization using virtual reality platforms. In: 2014 IEEE international conference on big data (big data). IEEE, pp 609–614

  12. Gaeta E, Beltrán-Jaunsaras M E, Cea G, Spieler B, Burton A, García-betances RI, Cabrera-umpiérrez MF, Brown D, Boulton H, Waldmeyer MT A (2019) Evaluation of the create@ school game-based learning–teaching approach. Sensors 19(15):3251

    Article  Google Scholar 

  13. Hartono M, Candramata M A, Adhyatmoko K N, Yulianto B (2016) Math education game for primary school. In: 2016 International conference on information management and technology (ICIMTech). IEEE, pp 93–96

  14. Horii H, Miyajima Y (2013) Augmented reality-based support system for teaching hand-drawn mechanical drawing. Procedia-Social Behav Sci 103:174–180

    Article  Google Scholar 

  15. Kane L, Khanna P (2017) Vision-based mid-air unistroke character input using polar signatures. IEEE Trans Hum-Mach Syst 47(6):1077–1088

    Article  Google Scholar 

  16. Kato H, Billinghurst M, Poupyrev I (2000) Artoolkit version 2.33. Human Interface Lab, Universidade de Washington

  17. Khan D, Rehman I, Ullah S, Ahmad W, Cheng Z, Jabeen G, Kato H et al (2019) A low-cost interactive writing board for primary education using distinct augmented reality markers. Sustainability 11(20):5720

    Article  Google Scholar 

  18. Lech M, Kostek B, Czyzewski A (2012) Virtual whiteboard: a gesture-controlled pen-free tool emulating school whiteboard. Intell Decis Technol 6(2):161–169

    Article  Google Scholar 

  19. Lee K -R, Chang W -D, Kim S, Im C -H (2016) Real-time “eye-writing” recognition using electrooculogram. IEEE Trans Neural Syst Rehabilit Eng 25(1):37–48

    Article  Google Scholar 

  20. Li Q, Cao H, Lu Y, Yan H, Li T (2016) Controlling non-touch screens as touch screens using airpen, a writing tool with in-air gesturing mode. In: 2016 International symposium on system and software reliability (ISSSR). IEEE, pp 68–76

  21. Liang J -M, Su W -C, Chen Y -L, Wu S -L, Chen J -J (2019) Smart interactive education system based on wearable devices. Sensors 19 (15):3260

    Article  Google Scholar 

  22. Magori V (1994) Ultrasonic sensors in air. In: 1994 Proceedings of IEEE ultrasonics symposium, vol 1. IEEE, pp 471–481

  23. Mallicoat S W (1995) Laser-scanned interactive whiteboard. In: Micro-optics/micromechanics and laser scanning and shaping, vol 2383. International Society for Optics and Photonics, pp 419–426

  24. Mohandes M, Aliyu S, Deriche M (2015) Prototype arabic sign language recognition using multi-sensor data fusion of two leap motion controllers. In: 2015 IEEE 12th international multi-conference on systems, signals & devices (SSD15). IEEE, pp 1–6

  25. Monzo C, Cobo G, Morán J A, Santamaría E, García-Solórzano D (2020) ab@ home: The open university of catalonia hands-on electronics laboratory for online engineering education. Electronics 9(2):222

    Article  Google Scholar 

  26. Rabbi I, Ullah S (2015) Extending the tracking distance of fiducial markers for large indoor augmented reality applications. Adv Electr Comput Eng 15 (2):59–65

    Article  Google Scholar 

  27. Rahim M A, Shin J, Islam M R (2020) Hand gesture recognition-based non-touch character writing system on a virtual keyboard. Multimed Tools Appl 1–24

  28. Rautaray S S, Agrawal A (2011) Interaction with virtual game through hand gesture recognition. In: 2011 International conference on multimedia, signal processing and communication technologies. IEEE, pp 244–247

  29. Rehman I U, Ullah S, Raees M (2019) Two hand gesture based 3d navigation in virtual environments. IJIMAI 5(4):128–140

    Article  Google Scholar 

  30. Rehman I U, Ullah S, Khan D, Khalid S, Alam A, Jabeen G, Rabbi I, Rahman H U, Ali N, Azher M et al (2020) Fingertip gestures recognition using leap motion and camera for interaction with virtual environment. Electronics 9(12):1986

    Article  Google Scholar 

  31. Sabir K, Stolte C, Tabor B, O’Donoghue S I (2013) The molecular control toolkit: Controlling 3d molecular graphics via gesture and voice. In: 2013 IEEE symposium on biological data visualization (biovis). IEEE, pp 49–56

  32. Schaub M et al (2012) The effects of promethean boards on student achievement

  33. Soares C, Moreira RS, Torres JM, Sobral P (2013) Locoboard: low-cost interactive whiteboard using computer vision algorithms. ISRN Machine Vision

  34. Tateno K, Kitahara I, Ohta Y (2007) A nested marker for augmented reality. In: 2007 IEEE virtual reality conference. IEEE, pp 259–262

  35. Ullah S, Khan D, Rahman S U, Alam A (2016) Marker based interactive writing board for primary level education. Pak J Sci 68(3):366

    Google Scholar 

  36. Vergara D, Fernández M L, Lorenzo M (2019) Enhancing student motivation in secondary school mathematics courses: a methodological approach. Educ Sci 9(2):83

    Article  Google Scholar 

  37. Wang R Y, Popović J (2009) Real-time hand-tracking with a color glove. ACM Trans Graph (TOG) 28(3):1–8

    Google Scholar 

  38. Xu D (2006) A neural network approach for hand gesture recognition in virtual reality driving training system of spg. In: 18th international conference on pattern recognition (ICPR’06), vol 3. IEEE, pp 519–522

  39. Zhang Q, Qin C (2013) Research on key technology of electromagnetic electronic whiteboard. Chin J Electron Dev 1

Download references

Author information

Authors and Affiliations

  1. Department of CS & IT, University of Malakand, Chakdara, Pakistan

    Inam Ur Rehman & Sehat Ullah

Authors
  1. Inam Ur Rehman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sehat Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Inam Ur Rehman.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rehman, I.U., Ullah, S. Gestures and marker based low-cost interactive writing board for primary education. Multimed Tools Appl 81, 1337–1356 (2022). https://doi.org/10.1007/s11042-021-11366-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11366-1

Keywords

Search

Navigation