Keisuke Kawahara
Mose Sakashita
Amy Koike
Ippei Suzuki
Kenta Suzuki
Yoichi Ochiai
ABSTRACT
We propose a system for transmitting a human performer's body and facial movements to a puppet with audiovisual feedback to the performer. The system consists of a head-mounted display (HMD) that shows the performer the video recording of the puppet's view, a microphone for voice capture, and photoreflectors for detecting the mouth movements of the human performer. In conventional puppetry, there is also the need for practice in the manipulation of the puppets to achieve good performance. The proposed telepresence system addresses these issues by enabling the human performer to manipulate the puppet through their own body and facial movements. The proposed system is expected to contribute to the development of new applications of puppetry and expand the interactivity of puppetry and the scope of entertainment.
- E. Blumenthal. 2005. Puppetry and Puppets: An Illustrated World Survey. Thames & Hudson.Google Scholar
- Leonardo Bonanni, Cati Vaucelle, Jeff Lieberman, and Orit Zuckerman. 2006. PlayPals: Tangible Interfaces for Remote Communication and Play. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 574--579. Google ScholarDigital Library
- Robert Held, Ankit Gupta, Brian Curless, and Maneesh Agrawala. 2012. 3D Puppetry: A Kinect-based Interface for 3D Animation. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 423--434. Google ScholarDigital Library
- Jun Ki Lee, R. L. Toscano, W. D. Stiehl, and C. Breazeal. 2008. The design of a semi-autonomous robot avatar for family communication and education. In RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication. 166--173.Google Scholar
- Hao Li, Laura Trutoiu, Kyle Olszewski, Lingyu Wei, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls, and Chongyang Ma. 2015. Facial Performance Sensing Head-mounted Display. ACM Trans. Graph. 34, 4, Article 47 (July 2015), 9 pages.Google ScholarDigital Library
- Oculus.inc. 2014. Oculus Rift Develop kit 2 (last accessed August 27, 2016). (2014). https://www.oculus.com/en-us/dk2/Google Scholar
- Emil Polyak. 2012. Virtual Impersonation Using Interactive Glove Puppets. In SIGGRAPH Asia 2012 Posters (SA '12). ACM, New York, NY, USA, Article 31, 1 pages. Google ScholarDigital Library
- Mose Sakashita, Keisuke Kawahara, Amy Koike, Kenta Suzuki, Ippei Suzuki, and Yoichi Ochiai. 2016. Yadori: Mask-type User Interface for Manipulation of Puppets. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH '16). ACM, New York, NY, USA, Article 23, 1 pages.Google ScholarDigital Library
- Dairoku Sekiguchi, Masahiko Inami, and Susumu Tachi. 2001. RobotPHONE: RUI for interpersonal communication. In CHI'01 Extended Abstracts on Human Factors in Computing Systems. ACM, 277--278. Google ScholarDigital Library
- Ronit Slyper, Guy Hoffman, and Ariel Shamir. 2015. Mirror Puppeteering: Animating Toy Robots in Front of a Webcam. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 241--248. Google ScholarDigital Library
- Yuta Sugiura, Calista Lee, Masayasu Ogata, Anusha Withana, Yasutoshi Makino, Daisuke Sakamoto, Masahiko Inami, and Takeo Igarashi. 2012. PINOKY: A Ring That Animates Your Plush Toys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 725--734. Google ScholarDigital Library
Index Terms
- Transformed Human Presence for Puppetry
Recommendations
You as a Puppet: Evaluation of Telepresence User Interface for Puppetry
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and TechnologyWe propose an immersive telepresence system for puppetry that transmits a human performer's body and facial movements into a puppet with audiovisual feedback to the performer. The cameras carried in place of puppet's eyes stream live video to the HMD ...
Super wide viewer using catadioptrical optics
SIGGRAPH '04: ACM SIGGRAPH 2004 PapersMany applications have used a head-mounted display (HMD), such as in virtual and mixed realities and telepresence. However, the field of view (FOV) of commercial HMD systems is too narrow for feeling immersion. In this paper, we propose a super-wide ...
Super wide viewer using catadioptrical optics
Many applications have used a head-mounted display (HMD), such as in virtual and mixed realities and telepresence. However, the field of view (FOV) of commercial HMD systems is too narrow for feeling immersion. In this paper, we propose a super-wide ...
Comments