Mahsan Rofouei
A.J. Brush
ABSTRACT
Determining who is interacting with a multi-user interactive touch display is challenging. We describe a technique for associating multi-touch interactions to individual users and their accelerometer-equipped mobile devices. Real-time device accelerometer data and depth camera-based body tracking are compared to associate each phone with a particular user, while body tracking and touch contacts positions are compared to associate a touch contact with a specific user. It is then possible to associate touch contacts with devices, allowing for more seamless device-display multi-user interactions. We detail the technique and present a user study to validate and demonstrate a content exchange application using this approach.
- Maunder, A. J., Marsden, G., and Harper, R. SnapAndGrab: accessing and sharing contextual multimedia content using Bluetooth enabled camera phones and large situated displays. In CHI 2008 Extended Abstracts, 2319--2324. Google Scholar
Digital Library
- Hutama, H., Song, P., Fu, C. and Goh, W. B. Distinguishing multiple smart-phone interactions on a multi-touch wall display using tilt correlation. Proc. CHI 2011, 3315--3318. Google ScholarDigital Library
- Morris, M. R., Fisher, D., and Wigdor, D. Search on surfaces: Exploring the potential of interactive tabletops for collaborative search tasks. Inf. Processing & Management, 2009. Google ScholarDigital Library
- Schmidt, D., Chehimi, F., Rukzio, E., and Gellersen, H., PhoneTouch: a technique for direct phone interaction on surfaces, Proc. UIST2010. Google ScholarDigital Library
- Dohse, K. C., Dohse, T., Still, J., and Parkhurst, D. J. Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. Proc. Advances in Computer-Human Interaction 2008, 297--302. Google ScholarDigital Library
- Dietz, P. H., and Leigh, D. DiamondTouch: A multi-user touch technology. Proc. UIST 2001, 219--226. Google ScholarDigital Library
- Scott, S. D., Carpendale, M. S. T., and Inkpen, K. M. Territoriality in collaborative tabletop workspaces. Proc. CSCW 2004, 294--303. Google ScholarDigital Library
- Rukzio, E., Schmidt, A., and Hussmann, H. An analysis of the usage of mobile phones for personalized interactions with ubiquitous public displays. Workshop on Ubiquitous Display Environments in conjunction with UbiComp 2004, Nottingham, UK, 2004.Google Scholar
- Grimes, A., Tarasewich, P., and Campbell, C. Keeping information private in the mobile environment. Position paper presented at First Intl. Workshop on Social Implications of Ubiquitous Computing at CHI 2005.Google Scholar
- Schöning, J., Rohs, M., Krüger A. Using Mobile Phones to Spontaneously Authenticate and Interact with MultiTouch Surfaces. AVI: Workshop on designing multitouch interaction techniques for coupled private and public displays PPD, 2008.Google Scholar
- Seewoonauth, K., Rukzio, E., Hardy, R., Holleis, P. Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone, Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, September 15--18, 2009. Google ScholarDigital Library
- Michelle Annett, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2011. Medusa: a proximity-aware multi-touch tabletop. Proc. UIST 2011 337--346. Google ScholarDigital Library
Index Terms
- Your phone or mine?: fusing body, touch and device sensing for multi-user device-display interaction
Recommendations
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineMulti-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Thumb widgets: apply thumb-tracking to enhance capabilities of multi-touch on mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsWhile multi-touch design allows natural and flexible figure gestures in interacting with mobile devices, the palm-size screen often limits its potential in application and arouses issues such as inefficient mode switch and incomplete gesture. To enrich ...
Comments