Abstract
storytelling by a child, as an educational activity, influences significantly the child’s linguistic ability, thought process, imagination, and creativity. There presently exist many software-based storytelling applications. However, most are deemed not suitable to Chinese children due to various cultural and language barriers. In this paper, combining the characteristics of Chinese children and using the multimodal interaction pattern based on speech and pen-gesture, we present a 3D storytelling system for children. The usability of two versions of the storytelling system is evaluated. Evaluation results suggest version 2 of the system to be of higher usability, as are comments on revising the software.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jones, R.: Story Telling (2006), http://www.uigarden.net/english/ storytelling
Wright, A.: Creating stories with children. Oxford University Press, England (1995)
Qu, M.: Intelligent Equations for Chinese Children. China Women Publishing House (1998)
Bers, M., Cassell, J.: Interactive Storytelling Systems for Children: Using Technology to Explore Language and Identity. Journal of Interactive Learning Research (AACE) 9(2), 603–609 (1999)
Hourcade, J.P., Bederson, B.B., Druin, A., Taxen, G.: KidPad: Collaborative Storytelling for Children. In: Extended Abstracts of Human Factors in Computing Systems (CHI 2002) (2002)
Alborzi, H., Druin, A., et al.: Designing StoryRooms: Interactie storetelling space for children. In: Proceedings of Designing Interactive Systems(DIS-2000), pp. 95–105. ACM Press, New York (2000)
Vaucelle, C., Jehan, T.: Dolltalk: a computational toy to enhance children’s creativity. In: CHI 2002 (2002)
Kehoe, C., et al.: Out of the Lab and into the World: Bringing Story Listening Systems to the Classroom. In: AERA, 2004 (2004)
Ryokai, K., Vaucelle, C., Cassell, J.: Literacy Learning by Storytelling with a Virtual Peer. In: Proceedings of Computer Support for Collaborative Learning (2002)
Cassell, J., Ryokai, K.: Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling, Personal and ubiquitous computing, 5, 169–190 (2001)
Bolt, R.A.: “Put-that-there”: Voice and gesture at the graphics interface. ACM SIGGRAPH Computer Graphics 14(3), 262–270 (1980)
Oviatt, S.L.: Multimodal Interfaces, Handbook of Human-Computer Interface. In: Jacko, J., Sears, A. (eds.). Lawrence Erlbaum, New Jersey (2002)
Neal, J.G., Thielman, C.Y., Dobes, A., Haller, S.M., Shapiro, S.C.: Natural language with integrated deictic and graphic gestures. In: Maybury, M.T., Wahlster, W. (eds.) Readings In Intelligent User Interfaces, pp. 38–51. Morgan Kaufmann Publishers, San Francisco (1991)
Campana, E., Baldridge, J., Dowding, J., Hockey, B.A., Remington, R.W., Stone, L.S.: Using eye movements to determine referents in a spoken dialogue system. In: Proc. of workshop on perceptive user interface, Orland, Florida (2001)
Zhang, Q., Imamiya, A., Go, K., Mao, X.A.: Gaze and Speech Multimodal Interface. In: Proc. of the 24th International Conference on Distributed Computing Systems Workshops (ICDCSW’04) (2004)
Nicol, A., et al.: Children are Ready for Speech Technology - but is the Technology Ready for Them? Interaction Design and Children, Eindhoven, The Netherlands (2002)
Carroll, J.M.: Scenarios and Design Cognition. In: Dai, G.Z., (ed.) Dong, S.H, Chen, Y.D., Ren, X.S(sub-ed.), Proceedings of the APCHI, User Interaction Technology in the 21st Century, China, Beijing, Science Press, vol. 1, pp. 23–46 (2002)
Te’eni, D., Carey, J., Zhang, P.: Human Computer Interaction: Developing Effective Organizational Information Systems. John Wiley & Sons, Inc, USA: Hoboken (2006)
Dong, S.H.: Progress and Challenge of Human-Computer Interaction. JOURNAL OF COMPUTER-AIDED DESIGN and COMPUTER GRAPHICS 16(1), 1–13 (2004) (in Chinese)
Wang, D.L., Dai, G.Z.: Pen-Based User Interface Design Using Scenarios Tree. Journal of Computer-Aided Design & Computer Graphics 18(8), 1276–1280 (2006)
Lu, R.Q.: Knowledge Engineering and Knowledge Science at the Turn of the Century. Tsinghua University press, Beijing (2001)
Pfleger, N.: Context Based Multimodal Fusion. In: Proceedings of ICMI’04, State College, Pennsylvania, USA, pp. 265–272 (2004)
Oviatt, S.L.: Mutual disambiguation of recognition errors in a multimodal Architecture. In: Proc. CHI’99 Human Factors in Computing Systems Conf. Pittsburgh, PA, pp. 576–583
Carroll, J.M.: HCI Models, Theories and Frameworks Toward a Multidisciplinary Science. Morgan Kaufmann, San Francisco (2003)
Gabbard, J.L., Hix, D., Swan II, J.E.: User-Centered design and Evaluation of Virtual Environments. IEEE Computer Graphics and Applications 19(6), 51–59 (1999)
Mayhew, D.J.: The Usability Engineering Lifecycle: A Practitioner’s Handbook for User Interface Design. Morgan Kaufmann, USA (1999)
Mayhew, J.D: The Usability Engineering Lifecycle. Morgan Kaufmann, San Francisco (1999)
Welie, M., Veer, G.C.: Breaking down Usability, Anton Eliëns? (1999)
Sauro, J., Kindlund, E.: A method to standardize usability metrics into a single score. In: CHI 2005, pp. 401–409
Zhang, Y.S.: Respect, Understanding, Interaction – Inspiration from the American Family, Beijing Education 377(2), 16–18 (2002)
Wang, D., Zhang, J., Dai, G.A: Multimodal Fusion Framework for Children’s Storytelling Systems. In: Pan, Z., Aylett, R., Diener, H., Jin, X., Göbel, S., Li, L. (eds.) Technologies for E-Learning and Digital Entertainment. LNCS, vol. 3942, pp. 585–588. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Wang, D., Zhang, J., Li, J., Dai, G., Lin, Q. (2007). A Multimodal 3D Storytelling System for Chinese Children. In: Hui, Kc., et al. Technologies for E-Learning and Digital Entertainment. Edutainment 2007. Lecture Notes in Computer Science, vol 4469. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73011-8_50
Download citation
DOI: https://doi.org/10.1007/978-3-540-73011-8_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73010-1
Online ISBN: 978-3-540-73011-8
eBook Packages: Computer ScienceComputer Science (R0)