skip to main content
10.1145/2642918.2647402acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Dyadic projected spatial augmented reality

Published: 05 October 2014 Publication History

Abstract

Mano-a-Mano is a unique spatial augmented reality system that combines dynamic projection mapping, multiple perspective views and device-less interaction to support face to face, or dyadic, interaction with 3D virtual objects. Its main advantage over more traditional AR approaches, such as handheld devices with composited graphics or see-through head worn displays, is that users are able to interact with 3D virtual objects and each other without cumbersome devices that obstruct face to face interaction. We detail our prototype system and a number of interactive experiences. We present an initial user experiment that shows that participants are able to deduce the size and distance of a virtual projected object. A second experiment shows that participants are able to infer which of a number of targets the other user indicates by pointing.

Supplementary Material

suppl.mov (uistf3715-file3.mp4)
Supplemental video

References

[1]
Arthur, K., Booth, K.S., and Ware, C. 1993. Evaluating 3D Task Performance for Fish Tank Virtual Worlds. In ACM Trans. on Information Systems, 11(3). 239--265.
[2]
Agrawala, M., Beers, A.C., McDowall, I., Fröhlich, B., Bolas, M., and Hanrahan. P. 1997. The two-user Responsive Workbench: support for collaboration through individual views of a shared space. In Proc. of ACM SIGGRAPH '97. 327--332.
[3]
Benko, H., Jota, R. and Wilson, A. D. 2012. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proc. of ACM CHI '12. 199--208.
[4]
Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA.
[5]
Bimber, O., Fröhlich, B., Schmalstieg, D., and Encarnacao, L. M. 2002. The Virtual Showcase. IEEE Comput. Graph. Appl., 21(6) (November 2001). 48--55.
[6]
Broecker, M., Smith, R.T., and Thomas, B. 2014. Depth Perception in View-Dependent Near-Field Spatial AR. Australasian User Interface Conf. (AUIC '14). (poster).
[7]
Cakmakci, O., Member, S., Rolland, J., and Member, A. 2006. Head-Worn Displays: A Review. IEEE Journal of Display Technology.
[8]
Cruz-Neira, C., Sandin, D.J., and DeFanti, T.A. 1993. Surround-screen projection-based virtual reality: The design and implementation of the CAVE. In Proc. of ACM SIGGRAPH '93. 135--142.
[9]
Cutting, J.E., and Vishton, P.M. 1995. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In W. Epstein and S. Rogers (eds). Handbook of perception of space and motion, 69--117.
[10]
Gilinsky, A.S. 1951. Perceived Size and Distance in Visual Space. Psychological Review, 58, 460--480.
[11]
Hancock, M., Nacenta, M., Gutwin, C., and Carpendale, S. 2009. The effects of changing projection geometry on the interpretation of 3D orientation on tabletops. In Proc. of ACM ITS '09. 175--182.
[12]
Harrison, C., Benko, H., and Wilson, A.D. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. of ACM UIST '11. 441--450.
[13]
Heo, H., Park, H.K., Kim, S., Chung, J., Lee, G. and Lee, W. 2014. Transwall: a transparent double-sided touch display facilitating co-located face-to-face interactions. In CHI '14 Extended Abstracts. 435--438.
[14]
Hirakawa, M. and Koike, S. 2004. A Collaborative Augmented Reality System Using Transparent Display. In Proc. of the IEEE Int. Symposium on Multimedia Software Engineering (ISMSE '04). 410--416.
[15]
Hou, J., Nam, Y., Peng, W., and Lee, K.M. 2012. Effects of screen size, viewing angle, and players' immersion tendencies on game experience. Comp. in Human Behavior, 28(2). 617--623.
[16]
Howard, I. 2012. Perceiving in Depth. New York: Oxford University Press. ISBN 978-0--199--76414--3.
[17]
Ishii, H. and Kobayashi, M. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proc. of ACM CHI '92. 525--532.
[18]
Jones, B., Benko, H., Ofek, E., and Wilson, A. D. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proc. of ACM CHI '13.
[19]
Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntyre, B., Raghuvanshi, N., Shapira, L. 2014. Roomalive: Magical Experiences Enabled by Scalable Adaptive Projector Camera Units. In Proc. of ACM UIST '14.
[20]
Khoshelham, K. 2012. Accuracy Analysis of Kinect Depth Data. In Proc. Of Int. Achieves of Photogrammetry, Remote Sensing and SI Sciences. Aug.
[21]
Kitamura, Y., Konishi, T., Masaki, T. and Kishino, F. 2001. IllusionHole: A Stereoscopic Display for Multiple Observers. In Proc. SPIE vol. 4297, Stereoscopic Displays and Virtual Reality Systems VIII.
[22]
Olwal, A., DiVerdi, S., Candussi, N., Rakkolainen, I., and Hollerer, T. 2006. An Immaterial, Dual-sided Display System with 3D Interaction. In Proc. of IEEE Conference on Virtual Reality (VR '06). 279--280.
[23]
Pinhanez, C. S. 2001. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Proc. of ACM UBICOMP '01. 315--331.
[24]
Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., and Forlines, C. 2003. iLamps: Geometrically aware and self-configuring projectors. ACM TOG 223, 809--818.
[25]
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L. and Fuchs, H. 1998. The office of the future: a unified approach to image-based modeling and spatially immersive displays. In Proc. of ACM SIGGRAPH '98. 179--188.
[26]
Raskar, R., Welch, G. and Fuchs, H. 1998. Spatially Augmented Reality. In Proc. of IEEE Workshop on Augmented Reality (IWAR'98).
[27]
Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. 2001. Shader Lamps: Animating Real Objects with Image-Based Illumination. In Proc. of the Eurographics Workshop on Rendering Techniques. 89--102.
[28]
Rekimoto, J. and Saitoh, M. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proc. of ACM SIGCHI '99. 378--385.
[29]
Richardson, J.T.E. 1994. Gender differences in mental rotation. Perceptual and Motor Skills, 78. 435--448.
[30]
Sekular, R.B. Perception. 2nd Edition. (1990).
[31]
Sheridan, T.B. 1992. Musings on telepresence and virtual presence. Presence: Teleoperators and Virtual Environments, 1(1). 120--125.
[32]
Sollenberger, R.L. and Milgram, P. 1991. A comparative study of rotational and stereoscopic computer graphics depth cues. In Proc. of Human Factors Society 35th Annual Meeting. 1452--1456.
[33]
Stevens, B. Jerrams-Smith, J., Heathcote, D. and Callear, D. 2002. Putting the Virtual into Reality: Assessing Object-Presence with Projection-Augmented Models. Presence, 11(1). 79--92.
[34]
Tang, Y., Lam, B., Stavness, I., and Fels, S. 2011. Kinectbased augmented reality projection with perspective correction. In ACM SIGGRAPH '11. (poster).
[35]
Underkoffler, J., Ullmer, B., and Ishii, H. 1999. Emancipated pixels: Real-world graphics in the luminous room. In Proc. of ACM SIGGRAPH '99. 385--392.
[36]
Wilson, A. 2007. Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction. In Proc. of IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '07). 201--204.
[37]
Wilson A. and Benko H. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. of ACM UIST'10. 273282.
[38]
Wilson, A. D., Benko, H., Izadi, S., and Hilliges, O. 2012. Steerable Augmented Reality with the Beamatron. In Proc. of ACM UIST '12. 413--422.
[39]
Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. 2008. Bringing physics to the surface. In Proc. of ACM UIST '08. 67--76.
[40]
Winer, B.J., Brown, D. and Michels, K. 1991. Statistical Principles in Experimental Design, 3rd Ed. New York, NY. McGraw-Hill.

Cited By

View all
  • (2024)Grafik Tasarımda 21. Yüzyıl Tasarım Trendleri ve YönelimleriMedeniyet Sanat Dergisi10.46641/medeniyetsanat.144047610:1(8-29)Online publication date: 30-Jun-2024
  • (2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
  • (2024)Watch Your Mouth: Silent Speech Recognition with Depth SensingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642092(1-15)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology
October 2014
722 pages
ISBN:9781450330695
DOI:10.1145/2642918
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. depth cameras
  3. projector camera system

Qualifiers

  • Research-article

Conference

UIST '14

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;
Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)114
  • Downloads (Last 6 weeks)8
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Grafik Tasarımda 21. Yüzyıl Tasarım Trendleri ve YönelimleriMedeniyet Sanat Dergisi10.46641/medeniyetsanat.144047610:1(8-29)Online publication date: 30-Jun-2024
  • (2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
  • (2024)Watch Your Mouth: Silent Speech Recognition with Depth SensingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642092(1-15)Online publication date: 11-May-2024
  • (2024)A Study on Collaborative Visual Data Analysis in Augmented Reality with Asymmetric Display TypesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210330:5(2633-2643)Online publication date: 4-Mar-2024
  • (2024)Interactive Robotic Grinding: Interactive Building Metal Surface Design and Fabrication for Robotic GrindingHCI International 2024 Posters10.1007/978-3-031-61932-8_49(427-437)Online publication date: 1-Jun-2024
  • (2023)Methodological framework and tools for the participatory design of spatial interactive installations of augmented and mixed reality in arts and culture.Proceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3610015(1-5)Online publication date: 27-Sep-2023
  • (2023)Projectoroid:A Mobile Robot-Based SAR Display ApproachAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615793(1-3)Online publication date: 29-Oct-2023
  • (2023)SAWSense: Using Surface Acoustic Waves for Surface-bound Event RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580991(1-18)Online publication date: 19-Apr-2023
  • (2023)A Review of Deep Learning Solutions in 360° Video Streaming2023 12th International Conference on Modern Circuits and Systems Technologies (MOCAST)10.1109/MOCAST57943.2023.10176729(1-4)Online publication date: 28-Jun-2023
  • (2023)Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00137(1201-1210)Online publication date: 16-Oct-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media