Article

Interacting with dynamically defined information spaces using a handheld projector and a pen

Authors:

Ravin BalakrishnanAuthors Info & Claims

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

Pages 225 - 234

https://doi.org/10.1145/1166253.1166289

Published: 15 October 2006 Publication History

Abstract

The recent trend towards miniaturization of projection technology indicates that handheld devices will soon have the ability to project information onto any surface, thus enabling interfaces that are not possible with current handhelds. We explore the design space of dynamically defining and interacting with multiple virtual information spaces embedded in a physical environment using a handheld projector and a passive pen tracked in 3D. We develop techniques for defining and interacting with these spaces, and explore usage scenarios.

Supplementary Material

JPG File (1166289.jpg)

Download
10.63 KB

index.html (index.html)

Slides from the presentation

Download
.96 KB

ZIP File (p225-slides.zip)

Supplemental material for Interacting with dynamically defined information spaces using a handheld projector and a pen

Download
19.60 MB

Audio only (1166289.mp3)

Download
5.34 MB

Video (1166289.mp4)

Download
127.74 MB

References

[1]

Accot, J. and Zhai, S. (2002). More than dotting the i's - foundations for crossing-based interfaces. ACM CHI Conference on Human Factors in Computing Systems. p. 73--80.

Digital Library

[2]

Apitz, G. and Guimbretière, F. (2004). CrossY: a crossing-based drawing application. ACM UIST Symposium on User Interface Software and Technology. p. 3--12.

Digital Library

[3]

Barfield, W. and Caudell, T., eds. Fundamentals of wearable computers and augmented reality. 2001, Lawrence Erlbaum Associates: Mahwah, New Jersey.

Digital Library

[4]

Beardsley, P., Baar, J. V., Raskar, R., and Forlines, C. (2005). Interaction using a handheld projector. IEEE Computer Graphics and Applications, 25(1). p. 39--43.

Digital Library

[5]

Bell, B., Feiner, S., and Höllerer, T. (2001). View management for virtual and augmented reality. ACM UIST Symposium on User Interface Software and Technology. p. 101--110.

Digital Library

[6]

Bier, E., Stone, M., Pier, K., Buxton, W., and DeRose, T. (1993). Toolglass and Magic Lenses: The see-through interface. ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. p. 73--80.

Digital Library

[7]

Blaskó, G., Coriand, F., and Feiner, S. (2005). Exploring interaction with a simulated wrist-worn projection display. ISWC'05 IEEE International Symposium on Wearable Computers. p. 2--9.

Digital Library

[8]

Brignull, H., Izadi, S., Fitzpatrick, G., Rogers, Y., and Rodden, T. (2004). The introduction of a shared interactive surface into a communal space. ACM CSCW Conference on Computer Supported Cooperative Work. p. 49--58.

Digital Library

[9]

Buxton, W., Living in augmented reality: Ubiquitous Media and Reactive Environments, in Video Mediated Communication, K. Finn, Sellen, A., Wilber, S., Editor. 1997, Erlbaum: Hillsdale, NJ. p. 363--384.

[10]

Buxton, W. and Myers, B. (1986). A study in two-handed input. ACM CHI 1986 Conference on Human Factors in Computing Systems. p. 321--326.

Digital Library

[11]

Fitzmaurice, G., Khan, A., Pieke, R., Buxton, B., and Kurtenbach, G. (2003). Tracking menus. ACM UIST Symposium on User Interface Software and Technology. p. 71--79.

Digital Library

[12]

Forlines, C., Balakrishnan, R., Beardsley, P., Baar, J. v., and Raskar, R. (2005). Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. ACM UIST Symposium on User Interface Software and Technology. p. 73--82.

Digital Library

[13]

Greenberg, S. and Rounding, M. (2001). The notification collage: posting information to public and personal displays. ACM CHI Conference on Human Factors in Computing Systems. p. 514--521.

Digital Library

[14]

Hilliges, O. and Terrenghi, L. (2006). Overcoming mode-changes on multi-user large displays with bi-manual interaction. MU3I Workshop on Multi-User and Ubiquitous User Interfaces.

[15]

Intille, S. S. (2002). Change blind information display for ubiquitous computing environments. Ubicomp. p. 91--106.

Digital Library

[16]

Matsushita, N., Ayatsuka, Y., and Rekimoto, J. (2000). Dual touch: A two-handed interface for pen-based PDAs. ACM UIST Symposium on User Interface Software and Technology. p. 211--212.

Digital Library

[17]

Morris, M. R., Ryall, K., Shen, C., Forlines, C., and Vernier, F. (2004). Beyond "social protocols": multi-user coordination policies for co-located groupware. ACM CSCW Conference on Computer Supported Cooperative Work. p. 262--265.

Digital Library

[18]

Patel, S., Rekimoto, J., and Abowd, G. (2006 - in press). iCam: Precise at-a-distance interaction in the physical environment. Pervasive.

Digital Library

[19]

Pingali, G., Pinhanez, C., Levas, A., Kjeldsen, R., Podlaseck, M., Chen, H., and Sukaviriya, N. (2003). Steerable Interfaces for Pervasive Computing Spaces. PerCom'03 IEEE International Conference on Pervasive Computing and Communications. p. 315--322.

Digital Library

[20]

Pinhanez, C. (2001). The everywhere display projector: A device to create ubiquitous graphical interfaces. Ubicomp. p. 315--331.

Digital Library

[21]

Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z., and Emele, M. (2004). Spotlight navigation: Interaction with a handheld projection device. International Conference on Pervasive Computing, Video paper.

[22]

Raskar, R., Beardsley, P., Baar, J. v., Wang, Y., Dietz, P., Lee, J., Leigh, D., and Willwacher, T. (2004). RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. ACM Transactions on Graphics, 23(3). p. 406--415.

Digital Library

[23]

Simon, A. (2005). First-person experience and usability of co-located interaction in a projection-based virtual environment. ACM Symposium on Virtual reality software and technology. p. 23--30.

Digital Library

[24]

Sugimoto, M., Miyahara, K., Inoue, H., and Tsunesada, Y. (2005). Hotaru: Intuitive Manipulation Techniques for Projected Displays of Mobile Devices. INTERACT 2005. p. 57--68.

Digital Library

[25]

Summet, J. and Suthankar, R. (2005). Tracking locations of moving hand-held displays using projected light. Pervasive. p. 37--46.

Digital Library

[26]

Tsang, M., Fitzmaurice, G. W., Kurtenbach, G., Khan, A., and Buxton, B. (2002). Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. ACM UIST Symposium on User Interface Software and Technology. p. 111--120.

Digital Library

[27]

Yee, K.-P. (2003). Peephole displays: pen interaction on spatially aware handheld computers. ACM CHI Conference on Human Factors in Computing Systems. p. 1--8.

Digital Library

Cited By

Takagi KNakanishi YJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Interactive Walking Experiences with Mobile Robot-based Spatial AR GameProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721742(1670-1674)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721742
Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Show More Cited By

Index Terms

Interacting with dynamically defined information spaces using a handheld projector and a pen
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms

Recommendations

Multi-user interaction using handheld projectors
UIST '07: Proceedings of the 20th annual ACM symposium on User interface software and technology

Recent research on handheld projector interaction has expanded the display and interaction space of handheld devices by projecting information onto the physical environment around the user, but has mainly focused on single-user scenarios. We extend this ...
X-large virtual workspaces for projector phones through peephole interaction
MM '12: Proceedings of the 20th ACM international conference on Multimedia

In peephole interaction a window to a virtual workspace is moved in space to reveal additional content. It is a promising interaction technique for mobile projector phones to display large workspaces which contain more information than can be ...
Handheld projector interaction

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

October 2006

354 pages

ISBN:1595933131

DOI:10.1145/1166253

General Chair:
Pierre Wellner
IDIAP Research Institute, Switzerland
,
Program Chair:
Ken Hinckley
Microsoft Research, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST06

Sponsor:

UIST06: The 19th Annual ACM Symposium on User Interface Software and Technology

October 15 - 18, 2006

Montreux, Switzerland

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

96
Total Citations
View Citations
2,212
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Takagi KNakanishi YJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Interactive Walking Experiences with Mobile Robot-based Spatial AR GameProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721742(1670-1674)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721742
Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Takagi KNakanishi Y(2023)Projectoroid:A Mobile Robot-Based SAR Display ApproachAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615793(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3615793
Yin JWu MBai SLiu HWei S(2023)A scrolling performance model based on two-dimensional touch peephole interactionsBehaviour & Information Technology10.1080/0144929X.2023.222677743:9(1758-1768)Online publication date: 20-Jun-2023
https://doi.org/10.1080/0144929X.2023.2226777
Joshi NIrudayaraj AHartmann JVogel D(2022)An Instrumented Office Chair with a Steerable Projector for Personal Spatial Augmented RealityProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3567705(1-12)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3567705
Thakur SUrs MIbrahim MSidenko AMajumder A(2022)Ambient Light Tolerant Laser-Pen Based Interaction with Curved Multi-projector DisplaysHuman-Computer Interaction. Technological Innovation10.1007/978-3-031-05409-9_14(180-194)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-05409-9_14
Xu SWu ZWang SFan RLin NIqbal SMacLean KChevalier FMueller S(2020)Hydrauio: Extending Interaction Space on the Pen through Hydraulic Sensing and Haptic OutputAdjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379350.3416180(43-45)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379350.3416180
Li NHan TTian FHuang JSun MIrani PAlexander JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Get a Grip: Evaluating Grip Gestures for VR Input using a Lightweight PenProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376698(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376698
Kemmoku YKomuro T(2018)A Large Effective Touchscreen Using a Head-Mounted ProjectorInformation10.3390/info90902359:9(235)Online publication date: 18-Sep-2018
https://doi.org/10.3390/info9090235
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten