Abstract
As more interactive surfaces enter public life, casual interactions from passersby are bound to increase. Most of these users can be expected to carry a mobile phone or PDA, which nowadays offers significant computing capabilities of its own. This offers new possibilities for interaction between these users’ private displays and large public ones. In this paper, we present a system that supports such casual interactions. We first explore a method to track mobile phones that are placed on a horizontal interactive surface by examining the shadows which are cast on the surface. This approach detects the presence of a mobile device, as opposed to any other opaque object, through the signal strength emitted by the built-in Bluetooth transceiver without requiring any modifications to the devices’ software or hardware. We then go on to investigate interaction between a Sudoku game running in parallel on the public display and on mobile devices carried by passing users. Mobile users can join a running game by placing their devices on a designated area. The only requirement is that the device is in discoverable Bluetooth mode. After a specific device has been recognized, a client software is sent to the device which then enables the user to interact with the running game. Finally, we explore the results of a study which we conducted to determine the effectiveness and intrusiveness of interactions between users on the tabletop and users with mobile devices.





Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Notes
Even though this value might not reflect the true received signal power, but rather some internal measure, we can accept this measurement as is, as we are currently relying on an experimentally determined threshold to decide between the inside- and outside-range cases.
References
Bluetooth SIG (2008) Core specification 2.1 + EDR. http://www.bluetooth.com/Bluetooth/Technology/Building/Specifications/
Carter S, Churchill E, Denoue L, Helfman J, Nelson L (2004) Digital graffiti: public annotation of multimedia content. In: CHI ’04 extended abstracts on human factors in computing systems, pp 1207–1210
Castano JG, Svensson M, Ekstrom M (2004) Local positioning for wireless sensors based on bluetooth. Radio and wireless conference, 2004 IEEE, 19–22 Sept, pp 195–198
Echtler F, Huber M, Klinker G (2008) Shadow tracking on multi-touch tables. In: AVI ’08: Proceedings of the working conference on advanced visual interfaces, pp 388–391
Echtler F, Klinker G (2008) A multitouch software architecture. In: Proceedings of NordiCHI 2008, October 2008, pp 463–466
Echtler F, Klinker G (2008) Tracking mobile phones on interactive tabletops. In MEIS ’08: Proceedings of the workshop on mobile and embedded interactive systems
Favela J, Rodriguez M, Preciado A, Gonzalez VM (2004) Integrating context-aware public displays into a mobile hospital information system. Inf Technol Biomed IEEE Trans 8:279–286
Greenberg S, Boyle M (1998) Moving between personal devices and public displays. In: Workshop on handheld CSCW, November 1998
Greenberg S, Boyle M, Laberge J (1999) PDAs and shared public displays: making personal information public, and public information personal. Pers Ubiquitous Comput 3:54–64
Greenberg S, Fitchett C (2001) Phidgets: easy development of physical interfaces through physical widgets. In UIST ’01: Proceedings of the 14th annual ACM symposium on user interface software and technology, pp 209–218
Hallberg J, Nilsson M, Synnes K (2003) Positioning with Bluetooth. Telecommunications, 2003. ICT 2003. 10th International Conference on 2:954–958
Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In UIST ’05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp 115–118
Huang EM, Mynatt ED (2003) Semi-public displays for small, co-located groups. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 49–56
Ishii H, Ullmer B (1997) Tangible bits: towards seamless interfaces between people, bits and atoms. In CHI ’97: Proceedings of the conference on human factors in computing systems, pp 34–241
Lee R, Greenspan G (2008) Jigsawdoku. http://www.jigsawdoku.com
Lee SK, Buxton W, Smith KC (1985) A multi-touch three dimensional touch-sensitive tablet. In CHI ’85: Proceedings of the ACM human factors in computing systems conference, ACM Press, San Francisco, CA, USA, pp 21–25
Magerkurth C, Stenzel R, Prante T (2003) Stars: a ubiquitous computing platform for computer augmented tabletop games. In: Adjunct proceedings of the fifth international conference on ubiquitous computing (UBICOMP’03), Springer, pp 267–268
Microsoft. Surface. http://www.microsoft.com/surface/, 2008
Rekimoto J (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In CHI ’02: Proceedings of the SIGCHI conference on human factors in computing systems, pp 113–120
Schöning J, Rohs M, Krüger A (2008) Using mobile phones to spontaneously authenticate and interact with multi-touch surfaces. In PPD’08. Workshop on designing multi-touch interaction techniques for coupled public and private displays, May 2008
Solon AJ, Callaghan MJ, Harkin J, McGinnity TM (2006) Case study on the Bluetooth vulnerabilities in mobile devices. IJCSNS 6(4):125
Wilson AD (2005) PlayAnywhere: a compact interactive tabletop projection-vision system. In UIST ’05: Proceedings of the 18th annual ACM symposium on user interface software and technology, pp 83–92
Wilson AD, Sarin R (2007) Bluetable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In GI ’07: Proceedings of graphics interface 2007, ACM Press, New York, NY, USA, pp 119–125
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Echtler, F., Nestler, S., Dippon, A. et al. Supporting casual interactions between board games on public tabletop displays and mobile devices. Pers Ubiquit Comput 13, 609–617 (2009). https://doi.org/10.1007/s00779-009-0246-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-009-0246-3