Abstract
Interactive tabletops have been proven to be very suitable setups for collaborative work especially in combination with mobile devices. Further on, many application scenarios require the visualization of 3D data. Therefore we present multimodal 3D interaction techniques for tabletops that allow simultaneous control of six degrees of freedom using sensor equipped mobile devices. In two early user studies we compared multitouch, tangible interaction and sensor equipped smartphones in order to start a User Centered Design process. We got important results regarding effectiveness, intuitiveness and user experience. Most notably we figured out that mobile devices equipped with acceleration sensors are very suitable for 3D rotation tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Akaoka, E., Ginn, T., Vertegaal, R.: DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In: Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI), pp. 49–56. ACM Press, New York (2010)
Ishii, H., Ratti, C., Piper, B., Wang, Y., Biderman, A., Ben-Joseph, E.: Bringing Clay and Sand into Digital Design - Continuous Tangible user Interfaces. BT Technology Journal 22, 287–299 (2004)
Piper, B., Ratti, C., Ishii, H.: Illuminating clay: Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 355–362. ACM Press, New York (2002)
Nebe, K., Klompmaker, F., Jung, H., Fischer, H.: Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 100–109. Springer, Heidelberg (2011)
Nebe, K., Müller, T., Klompmaker, F.: An Investigation on Requirements for Co-located Group-Work Using Multitouch-, Pen-Based- and Tangible-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 90–99. Springer, Heidelberg (2011)
Kaschny, M., Buron, S., von Zadow, U., Sostmann, K.: Medical education on an interactive surface. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 267–268. ACM Press, New York (2010)
Conradi, B., Hommer, M., Kowalski, R.: From digital to physical: learning physical computing on interactive surfaces. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 249–250. ACM Press, New York (2010)
McCrindle, C., Hornecker, E., Lingnau, A., Rick, J.: The design of t-vote: a tangible tabletop application supporting children’s decision making. In: 10th International Conference on Interaction Design and Children, pp. 181–184. ACM Press, New York (2011)
Hornecker, E.: Tangible User Interfaces als kooperationsunterstützendes Medium, Doctoral Thesis, Elektronische Bibliothek, Staats und UniversitŁtsbibliothek Bremen (2004)
Shen, C., Ryall, K., Forlines, C., Esenther, A., Vernier, F.D., Everitt, K., Wu, M., Wigdor, D., Morris, M.R., Hancock, M., Tse, E.: Informing the Design of Direct-Touch Tabletops. IEEE Comput. Graph. Appl. 26, 36–46 (2006)
Shen, C., Everitt, K., Ryall, K.: UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 281–288. Springer, Heidelberg (2003)
Morris, M.R., Cassanego, A., Paepcke, A., Winograd, T., Piper, A.M., Huang, A.: Mediating Group Dynamics through Tabletop Interface Design. IEEE Comput. Graph. Appl. 26(5), 65–73 (2006)
Kin, K., Agrawala, M., DeRose, T.: Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In: Graphics Interface, pp. 119–124. Canadian Information Processing Society (2009)
Yu, L., Svetachov, P., Isenberg, P., Everts, M.H., Isenberg, T.: FI3D: direct-touch interaction for the exploration of 3D scientific visualization spaces. IEEE Trans. Vis. Comput. Graph. 16(6), 1613–1622 (2010)
Hancock, M., ten Cate, T., Carpendale, S.: Sticky tools: full 6DOF force-based interaction for multi-touch tables. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 133–140. ACM Press, New York (2009)
Martinet, A., Casiez, G., Grisoni, L.: The design and evaluation of 3D positioning techniques for multi-touch displays. In: IEEE Symposium on 3D User Interfaces, pp. 115–118. IEEE Press, New York (2010)
Reisman, J.L., Davidson, P.L., Han, J.Y.: A screen-space formulation for 2D and 3D direct manipulation. In: 22nd Annual ACM Symposium on User Interface Software and Technology (UIST), pp. 69–78. ACM Press, New York (2009)
Klompmaker, F., Nebe, K.: Towards 3D Multitouch Interaction & Widgets. In: Workshop on Interaction Techniques in Real and Simulated Assistive Smart Environment, Workshop at the First International Joint Conference on Ambient Intelligence, AmI (2009)
Martinet, A., Casiez, G., Grisoni, L.: 3D positioning techniques for multi-touch displays. In: 16th ACM Symposium on Virtual Reality Software and Technology (VRST), pp. 227–228. ACM Press, New York (2009)
Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., Butz, A.: Interactions in the air: adding further depth to interactive tabletops. In: 22nd Annual ACM Symposium on User interface Software and Technology (UIST), pp. 139–148. ACM Press, New York (2009)
Klompmaker, F., Nebe, K., Fast, A.: dSensingNI - A Framework for Advanced Tangible Interaction using a Depth Camera. In: Sixth International Conference on Tangible, Embedded, and Embodied Interaction (TEI), pp. 217–224. ACM Press, New York (2012)
Cuypers, T., Francken, Y., Vanaken, C., van Reeth, F., Bekart, P.: Smartphone Localization on Interactive Surfaces Using the Built-in Camera. In: Procams, p. 448 (2009)
Wilson, A.D., Sarin, R.: BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In: Graphics Interface, pp. 119–125. ACM Press, New York (2007)
Schmidt, D., Chehimi, F., Rukzio, E., Gellersen, H.: Phone- Touch: a technique for direct phone interaction on surfaces. In: 23nd Annual ACM Symposium on User Interface Software and Technology (UIST), pp. 13–16. ACM Press, New York (2010)
Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: TUIO - A Protocol for Table Based Tangible User Interfaces. In: 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (2005)
Ullrich, D., Diefenbach, S.: INTUI. Exploring the Facets of Intuitive Interaction. In: Mensch & Computer, p. 251. Oldenbourg Verlag (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Klompmaker, F., Nebe, K., Eschenlohr, J. (2013). Towards Multimodal 3D Tabletop Interaction Using Sensor Equipped Mobile Devices. In: Uhler, D., Mehta, K., Wong, J.L. (eds) Mobile Computing, Applications, and Services. MobiCASE 2012. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36632-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-36632-1_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36631-4
Online ISBN: 978-3-642-36632-1
eBook Packages: Computer ScienceComputer Science (R0)