Simon Robinson
Matt Jones
Elina Vartiainen
ABSTRACT
In this article we describe a novel approach to collaborative video authoring using handheld projectors. PicoTales are created by sketching story elements on a projector+phone prototype, and then animated by moving the projected image. Movements are captured using motion sensor data, rather than visual or other tracking methods, allowing interaction and story creation anywhere. We describe in detail the design and development of our prototype device, and also address issues in position estimation and element tracking. An experiment was conducted to evaluate the prototype, demonstrating its accuracy and usability for ad-hoc creation of story videos. The potential of the system for story authoring is shown via a further experiment looking at the quality of the animated story videos produced. We conclude by considering possible future developments of the concept, and highlighting the benefits of our design for collaborative story capture.
Supplemental Material
- Ah Kun, L. and Marsden, G. Co-present photo sharing on mobile devices. In Proc. MobileHCI '07, ACM (2007), 277--284. Google Scholar
Digital Library
- Balabanović, M., Chu, L. and Wolff, G. Storytelling with digital photographs. In Proc. CHI '00, ACM (2000), 564--571. Google ScholarDigital Library
- Beardsley, P., Baar, J. van, Raskar, R. and Forlines, C. Interaction using a handheld projector. IEEE Computer Graphics and Applications 25.1 (2005), 39--43. Google ScholarDigital Library
- Bers, M. and Best, M. Rural connected communities: a project in online collaborative journalism. In Proc. CSCL '99, ISLS (1999), 41--46. Google ScholarDigital Library
- Bidwell, N., Reitmaier, T., Marsden, G. and Hansen, S. Designing with mobile digital storytelling in rural Africa. In Proc. CHI '10, ACM (2010), 1593--1602. Google ScholarDigital Library
- Cao, X. Handheld Projector Interaction. PhD thesis. University of Toronto, 2009. Google ScholarDigital Library
- Cao, X., Forlines, C. and Balakrishnan, R. Multi-user interaction using handheld projectors. In Proc. UIST '07, ACM (2007), 43--52. Google ScholarDigital Library
- Cao, X., Massimi, M. and Balakrishnan, R. Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays. In Proc. CSCW '08, ACM (2008), 77--86. Google ScholarDigital Library
- Cao, X., Lindley, S., Helmes, J. and Sellen, A. Telling the whole story: anticipation, inspiration and reputation in a field deployment of TellTable. In Proc. CSCW '10, ACM (2010), 251--260. Google ScholarDigital Library
- Chatting, D. and Sutton, J. Visible imagination: projected play. In Proc. HCI '09, BCS (2009), 405--409. Google ScholarDigital Library
- Cowan, L. and Li, K. ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In Proc. CHI '11, ACM (2011), 2707--2716. Google ScholarDigital Library
- Dao, V., Hosoi, K. and Sugimoto, M. A semi-automatic realtime calibration technique for a handheld projector. In Proc. VRST '07, ACM (2007), 43--46. Google ScholarDigital Library
- Druin, A., Stewart, J., Proft, D., Bederson, B. and Hollan, J. KidPad: a design collaboration between children, technologists, and educators. In Proc. CHI '97, ACM (1997), 463--470. Google ScholarDigital Library
- Fails, J., Druin, A. and Guha, M. Mobile collaboration: collaboratively reading and creating children's stories on mobile devices. In Proc. IDC '10, ACM (2010), 20--29. Google ScholarDigital Library
- Frohlich, D., Rachovides, D., Riga, K., Bhat, R., Frank, M., Edirisinghe, E., Wickramanayaka, D., Jones, M. and Harwood, W. StoryBank: mobile digital storytelling in a development context. In Proc. CHI '09, ACM (2009), 1761--1770. Google ScholarDigital Library
- Ghali, A., Benford, S., Bayoumi, S., Green, J. and Pridmore, T. Visually tracked flashlights as interaction devices. In Proc. Interact '03, IOS (2003), 487--494.Google Scholar
- Lee, G. and Keh, Y. A novel interface and application using synchronized multi projector phones. In MP2 Workshop at CHI '11, 2011.Google Scholar
- Löchtefeld, M., Schöning, J., Rohs, M. and Krüger, A. LittleProjectedPlanet: an augmented reality game for camera projector phones. In MIRW Workshop at MobileHCI '09, 2009.Google Scholar
- Olsen Jr., D. and Nielsen, T. Laser pointer interaction. In Proc. CHI '01, ACM (2001), 17--22. Google ScholarDigital Library
- Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z. and Emele, M. Spotlight navigation: interaction with a handheld projection device. In Pervasive '04 Videos, 2004.Google Scholar
- Reeves, S., Pridmore, T., Crabtree, A., Green, J., Benford, S. and O'Malley, C. The spatial character of sensor technology. In Proc. DIS '06, ACM (2006), 31--40. Google ScholarDigital Library
- Reitmaier, T., Bidwell, N. and Marsden, G. Field testing mobile digital storytelling software in rural Kenya. In Proc. MobileHCI '10, ACM (2010), 283--286. Google ScholarDigital Library
- Robinson, S. and Jones, M. HaptiProjection: multimodal mobile information discovery. In Ubiprojection Workshop at Pervasive '10, 2010.Google Scholar
- Sharmin, M., Bailey, B., Coats, C. and Hamilton, K. Understanding knowledge management practices for early design activity and its implications for reuse. In Proc. CHI '09, ACM (2009), 2367--2376. Google ScholarDigital Library
- Shilkrot, R., Hunter, S. and Maes, P. PoCoMo: projected collaboration using mobile devices. In Proc. MobileHCI '11, ACM (2011), 333--336. Google ScholarDigital Library
- Stanton, D., Neale, H. and Bayon, V. Interfaces to support children's co-present collaboration: multiple mice and tangible technologies. In Proc. CSCL '02, ISLS (2002), 342--351. Google ScholarDigital Library
- Strachan, S. and Murray-Smith, R. Bearing-based selection in mobile spatial interaction. Personal and Ubiquitous Computing 13.4 (2009), 265--280. Google ScholarDigital Library
- Sugimoto, M., Ito, T., Nguyen, T. and Inagaki, S. GENTORO: a system for supporting children's storytelling using handheld projectors and a robot. In Proc. IDC '09, ACM (2009), 214--217. Google ScholarDigital Library
- Virolainen, A., Åkerman, P. and Häkkilä, J. Burn-to-share: content sharing with mobile projectors. In Proc. MUM '10, ACM (2010), 18:1--18:4. Google ScholarDigital Library
- Weibel, N., Cowan, L., Pina, L., Griswold, W. and Hollan, J. Enabling social interactions through real-time sketch-based communication. In Proc. UIST '10 Demos, ACM (2010), 405--406. Google ScholarDigital Library
- Williamson, J., Murray-Smith, R. and Hughes, S. Shoogle: excitatory multimodal interaction on mobile devices. In Proc. CHI '07, ACM (2007), 121--124. Google ScholarDigital Library
- Willis, K. A pre-history of handheld projector-based interaction. Personal and Ubiquitous Computing (Online First; 21st April 2011), 1--11. Google ScholarDigital Library
- Willis, K., Poupyrev, I. and Shiratori, T. MotionBeam: a metaphor for character interaction with handheld projectors. In Proc. CHI '11, ACM (2011), 1031--1040. Google ScholarDigital Library
- Willis, K., Poupyrev, I., Hudson, S. and Mahler, M. SideBySide: ad-hoc multi-user interaction with handheld projectors. In Proc. UIST '11, ACM (2011), 431--440. Google ScholarDigital Library
- Worthington, P. Shadow Monsters. Interaction Design, Royal College of Art. 2005.Google Scholar
Index Terms
- PicoTales: collaborative authoring of animated stories using handheld projectors
Recommendations
Story Version Control and Graphical Visualization for Collaborative Story Authoring
CVMP '17: Proceedings of the 14th European Conference on Visual Media Production (CVMP 2017)This paper presents a story version control and graphical visualization framework to enhance collaborative story authoring. We propose a media-agnostic story representation based on story beats, events, and participants that describes the flow of events ...
JUNGLE: An Interactive Visual Platform for Collaborative Creation and Consumption of Nonlinear Transmedia Stories
Interactive StorytellingAbstractJUNGLE is an interactive, visual platform for the collaborative manipulation and consumption of nonlinear transmedia stories. Intuitive visual interfaces encourage JUNGLE users to explore vast libraries of story worlds, expand existing stories, or ...
A hybrid of plot-based and character-based interactive storytelling
Edutainment'07: Proceedings of the 2nd international conference on Technologies for e-learning and digital entertainmentInteractive storytelling in the virtual environment attracts a lot of research interests in recent years. Story plot and character are two most important elements of a story. Based on these two elements, currently there are two research directions: plot-...
Comments