Abstract
We present a virtual reality system targeted at building a calligraphy training environment. Our main goal is to construct a virtual space enabling learners to intuitively acquire hard-to-inherit skills through the development of a Japanese calligraphy training system. The proposed system provides a haptic interaction channel allowing the learners to intuitively master instructor’s fine motor skills through the sense of touch. We utilize a commercially available haptic device called PHANTOM for simulating a writing brush in a virtual training space. The system implements a function for recording and replaying instructor’s hand motions via the PHANTOM device. The instructor’s writing techniques such as brush-strokes and pen pressures are recorded when he/she is writing characters and they are effectively reproduced and presented to the learners via the PHANTOM device. The learners can master how to write the recorded characters by feeling the instructor’s style of handwritings. We implemented a simple yet powerful 3D brush model for real-time visualization of handwritten characters without compromising the quality and reality of the visualized characters. The learners can start training at any time and iterate training sessions without worrying about resource consumptions such as papers and ink as much as they like. We conducted two experiments to validate the effectiveness of the proposed system for learning calligraphy in a virtual environment.
Similar content being viewed by others
References
Chu NS, Tai CL (2004) Real-time painting with an expressive virtual Chinese brush. IEEE Comput Graph Appl 24(5):76–85
Eid M, Mansour M, El Saddik A, Iglesias R (2007) A haptic multimedia handwriting learning system. In: Proceedings of ACM EMME’07, pp 103–108, Sept 2007
Inami N, Tominaga H, Matsubara Y, Yamasaki T (2004) Pencil touch learning system for Japanese handwriting based on the haptic device. Trans IEICE, J87-D-I (12): 1128–1135 (in Japanese)
Keefe DF, Laidlaw DH (2005) A haptic interface for creating smooth 3D curves with varying line weight. In: Proceedings of ACM SIGGRAPH 2005 Posters, No. 99, 31 Jul–4 Aug 2005
Massie TH, Salisbury JK (1994) The PHANTOM haptic interface: a device for probing virtual objects. In: Proceedings on the ASME winter annual meeting, symposium on haptic interface for virtual environment and teleoperator systems, pp 295–299, Nov 1994
Nishino H, Takekata K, Sakamoto M, Salzman BA, Kagawa T, Utsumiya K (2005) An IEC-based haptic rendering optimizer. In: Proceedings of IEEE, soft computing as transdisciplinary science and technology (WSTST’05), Springer, pp 653–662, May 2005
Nishino H, Yamaguchi A, Kagawa T, Utsumiya K (2008) A networked virtual environment for teaching handwritten characters through haptization of human motor skills. In: Proceedings of IEEE 22th international conference on advanced information networking and applications (AINA2008), pp 840–847, Mar 2008
Nishino H, Yamaguchi A, Kagawa T, Utsumiya K (2009) A networked virtual environment for teaching handwritten characters through shared haptization. Int J Bus Intell Data Min 4(1):38–61
Nishino H, Murayama K, Kagawa T, Utsumiya K (2010) A Japanese calligraphy trainer based on skill acquisition through haptization. In: Proceedings of IEEE 24th international conference on advanced information networking and applications (AINA2010), pp 1225–1232, Apr 2010
Saga S, Kawakami N, Tachi S (2005) A study on teaching methods utilizing a proactivity in haptics. Trans Virtual Real Soc Jpn 10(3):363–370 (in Japanese)
Salisbury K, Conti F, Barbagli F (2004) Haptic rendering: introductory concepts. IEEE Comput Graph Appl 24(2):24–32
Takekata K, Salzman BA, Nishino H, Kagawa T, Utsumiya K (2005) An intuitive optimization method of haptic rendering using interactive evolutionary computation. In: Proceedings of IEEE international conference on systems, man, and cybernetics (SMC2005), pp 1896–1901, Oct 2005
Teo CL, Burdet E, Lim HP (2002) A robotic teacher of Chinese handwriting. In: Proceedings of the 10th IEEE international symposium on haptic interfaces for virtual environment and teleoperator systems (Haptics’02), pp 335–341, Mar 2002
Wada A, Shin J-P (2009) Three dimensional virtual calligraphy simulation with pen tablet. In: Proceedings of the 1st IEEE international workshop on aware computing (IWAC2009), pp 628–631, Sept 2009
Wang D, Zhang Y, Yao C (2006) Stroke-based modeling and haptic skill display for Chinese calligraphy simulation system. Virtual reality. Springer 9(2–3):118–132
Xu S, Francis Lau CM, Xu C, Pan Y (2005) Virtual hairy brush for digital painting and calligraphy. Sci China Ser. F inf sci (Springer) 48(3):285–303
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material 1 (WMV 6364 kb)
Supplementary material 2 (WMV 4599 kb)
Rights and permissions
About this article
Cite this article
Nishino, H., Murayama, K., Shuto, K. et al. A calligraphy training system based on skill acquisition through haptization. J Ambient Intell Human Comput 2, 271–284 (2011). https://doi.org/10.1007/s12652-010-0042-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-010-0042-y