ABSTRACT
Along with the number of pervasive displays in urban environments, recent advances in technology allow to display three-dimensional (3D) content on these displays. However, current input techniques for pervasive displays usually focus on interaction with two-dimensional (2D) data. To enable interaction with 3D content on pervasive displays, we need to adapt existing and create novel interaction techniques. In this paper we investigate remote interaction with 3D content on pervasive displays. We introduce and evaluate four 3D travel techniques that rely on well established interaction metaphors and either use a mobile device or depth tracking as spatial input. Our study on a large-scale stereoscopic display shows that the physical travel techniques (whole-body gestures) outperformed the virtual (mobile touch) techniques with respect to task performance time and error rate.
- Benzina, A., Dey, A., Tonnis, M., and Klinker, G. Empirical Evaluation of Mapping Functions for Navigation in Virtual Environments Using Phones with Integrated Sensors. International Journal of Innovative Computing, Information and Control (IJICIC) 9, 12 (Dec. 2013), 4693--4709.Google Scholar
- Boring, S., Jurmu, M., and Butz, A. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In Proceedings of the Annual Conference of the Australian Computer-Human Interaction, OZCHI '09, ACM (2009), 161--168. Google ScholarDigital Library
- Bowman, D. A., Kruijff, E., LaViola, J. J., and Poupyrev, I. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., 2004. Google ScholarDigital Library
- Capin, T., Haro, A., Setlur, V., and Wilkinson, S. Camera-based virtual environment interaction on mobile devices. In Lecture Notes in Computer Science 4263, 765 (2006), 773. Google ScholarDigital Library
- Diniz, N. V., Duarte, C. A., and Guimarães, N. M. Mapping interaction onto media facades. In Proceedings of the International Symposium on Pervasive Displays, PerDis '12, ACM (2012), 14:1--14:6. Google ScholarDigital Library
- Hart, S. G., and Stavenland, L. E. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload, P. A. Hancock and N. Meshkati, Eds. Elsevier, 1988, ch. 7, 139--183.Google Scholar
- Jurmu, M., Ogawa, M., Boring, S., Riekki, J., and Tokuda, H. Waving to a touch interface: Descriptive field study of a multipurpose multimodal public display. In Proceedings of the International Symposium on Pervasive Displays, PerDis '13, ACM (2013), 7--12. Google ScholarDigital Library
- Kratz, S., and Rohs, M. Extending the virtual trackball metaphor to rear touch input. In Proceedings of the Symposium on 3D User Interfaces, 3DUI '10, IEEE (2010), 111--114. Google ScholarDigital Library
- Liang, H.-N., Williams, C., Semegen, M., Stuerzlinger, W., and Irani, P. An Investigation of Suitable Interactions for 3D Manipulation of Distant Objects through a Mobile Device. International Journal of Innovative Computing, Information and Control (IJICIC) 9, 12 (Dec. 2013), 4737--4752.Google Scholar
- Steinicke, F., Hinrichs, K. H., Schöning, J., and Krüger, A. Multi-touching 3d data: Towards direct interaction in stereoscopic display environments coupled with mobile devices. In Advanced Visual Interfaces (AVI) Workshop on Designing Multi-Touch Interaction Techniques for Coupled Public and Private Displays (2008), 46--49.Google Scholar
- Ware, C., and Osborne, S. Exploration and virtual camera control in virtual three dimensional environments. In Proceedings of the Symposium on Interactive 3D Graphics, I3D '90, ACM (1990), 175--183. Google ScholarDigital Library
- Wingrave, C., Williamson, B., Varcholik, P. D., Rose, J., Miller, A., Charbonneau, E., Bott, J., and LaViola, J. The wiimote and beyond: Spatially convenient devices for 3d user interfaces. IEEE Computer Graphics and Applications 30, 2 (Mar. 2010), 71--85. Google ScholarDigital Library
Index Terms
- Interacting with 3D Content on Stereoscopic Displays
Recommendations
Exploring 3D manipulation on large stereoscopic displays
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive DisplaysIn the last years stereoscopic 3D has seen a drastic increase in popularity especially in terms of consumer-ready hardware and software. While the technology for input (smart-phone, Kinect, etc.) as well as output (passive/active stereoscopic and auto-...
Tangible displays for the masses: spatial interaction with handheld displays by using consumer depth cameras
Spatially aware handheld displays are a promising approach to interact with complex information spaces in a more natural way by extending the interaction space from the 2D surface to the 3D physical space around them. This is achieved by utilizing their ...
Estimating virtual touchscreen for fingertip interaction with large displays
OZCHI '06: Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and EnvironmentsLarge displays are everywhere. However, the computer mouse remains the most common interaction tool for such displays. We propose a new approach for fingertip interaction with large display systems using monocular computer vision. By taking into account ...
Comments