Skip to main content
Springer Nature Link
Log in

A pre-history of handheld projector-based interaction

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

I present a pre-history of contemporary handheld projector-based interaction to inform the design of future interactive systems. I begin by documenting the two main types of pre-cinema handheld projection from Europe and Japan, the handheld magic lantern and the utsushi-e performance. I then present a summary of projection techniques used by performers when interacting with these devices. I situate these techniques within contemporary research and illustrate how they are being used and built upon with contemporary technology. Finally, I discuss how knowledge of pre-cinema handheld projection devices, techniques, and performance can inform the design of future handheld projector systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. An unpublished English translation is available in the library of the Magic Lantern Castle Museum.

  2. Several notable English language sources are Prof. Machiko Kusahara’s utsushi-e website [24] and NHK World’s recent documentary on utsushi-e [25].

References

  1. Mannoni L, Campagnoni DP (2009) Lanterne Magique et Film Peint. Martinière, Paris

    Google Scholar 

  2. Crangle R, Heard M, van Dooren I (2005) Realms of light. The Magic Lantern Society, North Yorkshire

    Google Scholar 

  3. Markets And Markets (2010) Global pico projector market. http://www.marketsandmarkets.com/Market-Reports/pico-projector-market-196.html

  4. Wilson ML, Robinson S, Craggs D, Brimble K, Jones M (2010) Pico-ing into the Future of Mobile Projector Phones. In: Ext. Abstracts CHI ‘10, Atlanta, Georgia. ACM, pp 3997–4002

  5. Hang A, Rukzio E, Greaves A (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In: Mobile HCI ‘08. ACM, pp 207–216

  6. Bedwell B, Schnädelbach H, Chamberlain A, Caruana T (2010) Pervasive projection: exploring the potential of mobile phone projectors. In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 1–4

  7. Cowan L, Griswold WG, Hollan JD (2010) Applications of projector phones for social computing. In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 12–15

  8. Rogers Y, Payne SJ, Todd PM (2010) Projecting instant information in situ: can it help us make more informed decisions? In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 39–42

  9. Bimber O, Raskar R (2005) Spatial augmented reality: merging real and virtual worlds. A K Peters, Natick

    Google Scholar 

  10. Bolas M, Krum DM (2010) Augmented reality applications and user interfaces using head-coupled near-axis personal projectors with novel retroreflective props and surfaces. In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 5–8

  11. Rapp S, Michelitsch G, Osen M, Williams J, Barbisch M, Bohan R, Valsan Z, Emele M (2004) Spotlight navigation: interaction with a handheld projection device. In: Pervasive ‘04, Vienna, Austria

  12. Cao X, Balakrishnan R (2006) Interacting with dynamically defined information spaces using a handheld projector and a pen. In: UIST ‘06, Montreux, Switzerland. ACM, pp 225–234

  13. Beardsley P, van Baar J, Raskar R, Forlines C (2005) Interaction using a handheld projector. IEEE Comput Graph Appl 25(1):39–43

    Article  Google Scholar 

  14. Sugimoto M, Miyahara K, Inoue H, Tsunesada Y Hotaru (2005) Intuitive manipulation techniques for projected displays of mobile devices. In: INTERACT 2005, Rome, Italy. Springer, pp 57–68

  15. Blaskó G, Coriand F, Feiner S (2005) Exploring interaction with a simulated wrist-worn projection display. In: ISWC 2005, Osaka, Japan. IEEE, pp 2–9

  16. Puikkonen A, Häkkila J (2010) Exploring the basic interaction with projector phones—a user study. In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 28–31

  17. Mistry P, Maes P, Chang L (2009) WUW–Wear Ur World–a wearable gestural interface. In: Ext. Abstracts CHI ‘09, Boston, MA. ACM, pp 4111–4116

  18. Kircher A (1646) Ars Magna Lucis et umbrae. Amsterdam

  19. Robinson D, Herbert S, Crangle R (2001) Encyclopedia of the magic lantern. The Magic Lantern Society, North Yorkshire

    Google Scholar 

  20. Kobayashi G (1987) Utsushi-e. Chuo University Press, Tokyo

    Google Scholar 

  21. Minami H, Nagai H, Ozawa S (1982) Etoku–Kamishibai, Nozoki Karakuri. Utsushie no Sekai, Hakusuisha, Tokyo

    Google Scholar 

  22. Yamamoto K (1988) Edo no Kagee Asobi: Hikari to Kage no Bunkashi. Soshisha Publishing, Tokyo

    Google Scholar 

  23. Iwamoto K (2002) Centuries of magic lanterns in Japan. Shinwasha, Tokyo

    Google Scholar 

  24. Kusahara M (1999) Utsushi-e: Japanese traditional magic lantern show. http://www.f.waseda.jp/kusahara/Utsushi-e/. Accessed 5 Oct 2010

  25. NHK World (2010) Last artisans: lights of anime. Edo Utushi-e, NHK, Japan

    Google Scholar 

  26. Yamagata F Minwa-za Theatre Company. http://www.minwaza.com. Accessed 17 Oct 2010

  27. Schöning J, Rohs M, Kratz S, Löchtefeld M, Krüger A (2009) Map torchlight: a mobile augmented reality camera projector unit. In: Ext. Abstracts CHI ‘09, Boston, MA. ACM, pp 3841–3846

  28. Yoshida T, Hirobe Y, Nii H, Kawakami N, Tachi S (2010) Twinkle: interacting with physical surfaces using handheld projector. In: VR ‘10. IEEE, pp 87–90

  29. Willis KDD, Poupyrev I, Shiratori T (2011) Motion beam: a metaphor for character interaction with handheld projectors. In: CHI ‘11, Vancouver, Canada. ACM

  30. Hosoi K, Dao VN, Mori A, Sugimoto M (2007) VisiCon: a robot control interface for visualizing manipulation using a handheld projector. In: ACE ‘07, Salzburg, Austria. ACM, pp 99–106

  31. GT Tokyo Inc. (2009) Helicopter Boyz in Yomiuri Land. http://www.gtinc.jp/voice/2009/10/helicopter_boyz_in_yomiuri_lan.html

  32. Linder N (2010) LuminAR. http://fluid.media.mit.edu/people/natan/current/luminar.html. Accessed 17 Oct 2010

  33. Worthington P (2005) Shadow monsters. http://www.worthersoriginal.com/viki/#page=shadowmonsters. Accessed 6 Oct 2010

  34. Snibbe S (2002) Shadow. http://www.snibbe.com/projects/interactive/shadow. Accessed 6 Oct 2010

  35. Krueger MW, Gionfriddo T, Hinrichsen K (1985) VIDEOPLACE: an artificial reality. In: CHI ‘85. ACM, pp 35–40

  36. Krueger MW (1991) Artificial reality II. Addison-Wesly Publishing Company, Reading

    Google Scholar 

  37. Shoemaker G, Tang A, Booth KS (2007) Shadow reaching: a new perspective on interaction for large displays. In: UIST ‘07, Newport, Rhode Island, USA. ACM, pp 53–56

  38. Cao X, Forlines C, Balakrishnan R (2007) Multi-user interaction using handheld projectors. In: UIST ‘07, Newport, Rhode Island. ACM, pp 43–52

  39. Cao X, Massimi M, Balakrishnan R (2008) Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays. In: CSCW ‘08, San Diego, CA. ACM, pp 77–86

  40. Hosoi K, Dao VN, Mori A, Sugimoto M (2007) CoGAME: manipulation using a handheld projector. In: SIGGRAPH ‘07 Emerging Technologies, San Diego, California. ACM

  41. Laurel B (1991) Computers as theatre. Addison-Wesley, Reading

    Google Scholar 

  42. Dourish P (2001) Where the action is: the foundations of embodied interaction. MIT Press, Cambridge

    Google Scholar 

  43. Jacob RJK, Girouard A, Hirshfield LM, Horn MS, Shaer O, Solovey ET, Zigelbaum J (2008) Reality-based Interaction: a framework for post-WIMP interfaces. In: CHI 2008, Florence, Italy. ACM, pp 201–210

  44. Raskar R, van Baar J, Beardsley P, Willwacher T, Rao S, Forlines C (2003) iLamps: geometrically aware and self-configuring projectors. ACM Trans Graph 22(3):809–818

    Article  Google Scholar 

  45. Cauchard JR, Fraser M, Alexander J, Subramanian S (2010) Offsetting displays on mobile projector phones. In: Ubiprojection Workshop, Pervasive ‘10, Helsinki, Finland. pp 9–12

  46. Price S, Sheridan JG, Falcão TP (2010) Action and representation in tangible systems: implications for design of learning interactions. In: TEI ‘10, Cambridge, MA. ACM, pp 145–152

Download references

Acknowledgments

I firstly thank Jack Judson for providing me with access to his collection at the Magic Lantern Castle Museum and valuable historical information on handheld magic lanterns. I thank Mark D Gross for assisting with early drafts of this paper. I also thank Erkki Huhtamo for providing imagery and for his valuable lectures at Carnegie Mellon University and Waseda University. This project was partially funded by a GuSH grant from Carnegie Mellon University.

Author information

Authors and Affiliations

  1. Computational Design Lab, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA, 15213, USA

    Karl D. D. Willis

Authors
  1. Karl D. D. Willis
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Karl D. D. Willis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Willis, K.D.D. A pre-history of handheld projector-based interaction. Pers Ubiquit Comput 16, 5–15 (2012). https://doi.org/10.1007/s00779-011-0373-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-011-0373-5

Keywords