Akio Nakamura
ABSTRACT
This paper presents a multimodal information presentation method for a basic dance training system. The system targets on beginners and enables them to learn basics of dances easily. One of the most effective ways of learning dances is to watch a video showing the performance of dance masters. However, some information cannot be conveyed well through video. One is the translational motion, especially that in the depth direction. We cannot tell exactly how far does the dancers move forward or backward. Another is the timing information. Although we can tell how to move our arms or legs from video, it is difficult to know when to start moving them. We solve the first issue by introducing an image display on a mobile robot. We can learn the amount of translation just by following the robot. We introduce active devices for the second issue. The active devices are composed of some vibro-motors and are developed to direct action-starting cues with vibration. Experimental results show the effectiveness of our multimodal information presentation method.
- Chua, P.T. et al. Training for Physical Tasks in Virtual Environments: Tai Chi. Proc. the IEEE Virtual Reality 2003, (2003), 87--94. Google Scholar
Digital Library
- CREST Ikeuchi Project: Automatically Generating Multimedia Contents of Curtural Heritage Objects through Observation. http://www.cvl.iis.u-tokyo.ac.jp/crest/eng/.Google Scholar
- Hachimura, K. and Nakamura, M. Method of Generating Coded Description of Human Body Motion from Motion-Capture Data. Proc. the IEEE ROMAN 2001 Workshop, (2001), 122--127.Google Scholar
- Hachimura, K., et al. A Prototype Dance Training Support System with Motion Capture and Mixed Reality Technologies. Proc. the 13th IEEE Int. Workshop on Robot and Human Interactive Communication (RO-MAN 2004), (2004), CD-ROM.Google ScholarCross Ref
- Hattori, M., et al. An Analysis of the Bunraku Puppets Motions based on the Phase Factors of the Puppet's Motions Axes --For the Generation of Humanoid Robots' Motions with Fertile Emotions--. J. the Japan Society of Mechanical Engineers, no.66, vol.644, (2000), 1243--1249, in Japanese.Google Scholar
- Kosuge, K., et al. Dance Partner Robot --Ms DanceR--. Proc. the 2003 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS2003), (2003), CD-ROM.Google ScholarCross Ref
- Kuno, Y., et al. Motion Analysis of Dances and its Applications. Proc. the Int. Symposium on the CREST Digital Archiving Project, (2003), 183-193.Google Scholar
- Lindeman, R.W., et al. Effective Vibrotactile Cueing in a Visual Search Task. Proc. Interact 2003, (2003).Google Scholar
- Murakami, T., et al. Generation of Digital Contents for Traditional Dances by Integrating Appearance and Motion Data. Proc. the 2nd IASTED Int. Conf. Visualization, Imaging and Image Processing (VIIP 2002), (2002), 672-676.Google Scholar
- Niwayama, T., et al. Mobile Robot System for Easy Dance Training. Proc. 2004 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, (2004), CD-ROM.Google ScholarCross Ref
- Yoshimura, M., et al. A Trial for Identifying and Characterizing Typical Parts of Japanese Dancing. Trans. the Institute of Electronics, Information and Communication Engineers, vol.J84-A-D-II, no.12, (2001), 2644-2653, in Japanese.Google Scholar
- Yang, U. and Kim, G.J. Just Follow Me": An Immersive VR-based Motion Training System. Int. Conf. on Virtual Systems and Multimedia (VSMM), (1999).Google Scholar
- Yukawa, T., et al. Human Motion Description System Using BUYO-FU. IPSJ Journal, vol.41, no.10, (2000), in Japanese.Google Scholar
- Warabi-za Co.,Ltd. Digital Archives of Folk Dances Using MotionCapture. http://www.warabi.or.jp/buyo-fu/Google Scholar
- Warabi-za Co.,Ltd. DVD de oboeru series. http://www.warabi.or.jp/oboeru/index.html, in Japanese.Google Scholar
Index Terms
- Multimodal presentation method for a dance training system
Recommendations
Dance Motion Segmentation Method based on Choreographic Primitives
GRAPP 2015: Proceedings of the 10th International Conference on Computer Graphics Theory and ApplicationsData-driven animation using a large human motion database enables the programing of various natural human motions. While the development of a motion capture system allows the acquisition of realistic human motion, segmenting the captured motion into a ...
A Dance Synthesis System Using Motion Capture Data
Knowledge Acquisition: Approaches, Algorithms and ApplicationsThe aim of this system is to synthesize the choreography of the dance motions automatically by using the subjective music impression given by a user, even if the user has no knowledge to the dance at all. In order to show that the system is useful, we ...
Learning how to dance using a web 3D platform
ICWL'07: Proceedings of the 6th international conference on Advances in web based learningIn this paper we present the European project Open Dance and in particular our contribution to the 3D simulation of folk dances and their presentation on the web. Our aim is to provide a learning framework for folk dances. First we describe the ...
Comments