ABSTRACT
The proliferation of inexpensive connected devices has created a situation where a person, at any given moment, is surrounded by interactive computers. Despite this fact, there are very few means by which a user may take advantage of this large number of screens. We present Conductor, a prototype framework which serves as an exemplar for the construction of cross-device applications. We present a series of interaction methods by which users can easily share information, chain tasks across devices, and manage sessions across devices. We also present a cross-device usage scenario which utilizes several cross-device applications built within our prototype framework. We also describe a user study, which helped us to understand how users will take advantage of a large number of devices in support of performance of a sense making task.
Supplemental Material
- Andrews, C., Endert, A. and C. North. (2010). Space to think: large high-resolution displays for sensemaking. CHI 10, 55--64. Google ScholarDigital Library
- Begeman, M., Cook, P., et al.(1986). Project Nick: meetings augmentation and analysis. CSCW '86, 1--6. Google ScholarDigital Library
- Boring, S., Baur, D., et al. (2010). Touch projector: mobile interaction through video. CHI '10, 2287--2296). Google ScholarDigital Library
- Buxton, W. (1986). Chunking and phrasing and the design of human-computer dialogues. IFIP Congress, 475--480.Google Scholar
- Chen, N., Guimbretiere, F., & Sellen, A. (2012). Designing a multi-slate reading environment to support active reading activities. ACM ToCHI, 19 (3) 2012, 1--35. Google ScholarDigital Library
- Chen, N., Guimbretière, F., & Sellen, A. (2013). Graduate student use of multi-slate reading. CHI '13, 1799--1808. Google ScholarDigital Library
- Chung, H., Chu, S. L., and North, C. (2013). A comparison of two display models for collaborative sensemaking. Pervasive '13. Google ScholarDigital Library
- Fitzmaurice, G. W. et al. (2003). Sentient data access via a diverse society of devices. Queue, 1(8), 52--62. Google ScholarDigital Library
- Girouard, A., Tarun, A., & Vertegaal, R. (2012). DisplayStacks: interaction techniques for stacks of flexible thin-film displays. CHI 12, 2431--2440. Google ScholarDigital Library
- Greenberg, S., Marquardt, N., et al. (2011). Proxemic interactions: the new ubicomp' Interactions, 18(1), 42--50. Google ScholarDigital Library
- Grudin, J. (2001) Partitioningdigitalworlds:focaland peripheralawareness in multimonitoruse.CHI '01 458--465. Google ScholarDigital Library
- Hinckley, K. (2003, October). Bumping objects together as a semantically rich way of forming connections between ubiquitous devices. UbiComp '03.Google Scholar
- Hinckley, K. (2003). Synchronous gestures for multiple persons and computers. UIST 2003, 149--158. Google ScholarDigital Library
- Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., & Smith, M. (2004). Stitching: pen gestures that span multiple displays. AVI '04, 23--31. Google ScholarDigital Library
- Hollan, J., et al. (2000) Distributed cognition: toward a new foundation for human-computer interaction research. ACM ToCHI 7 (2) 2000, 174--196. Google ScholarDigital Library
- Hutchings, D., et al. (2004). Display space usage and window management operation comparisons between single monitor and multiple monitor users. AVI 04, 32--39. Google ScholarDigital Library
- Johanson, B., Fox, A., Winograd, T., (2002). The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing Magazine 1(2), April-June 2002. Google ScholarDigital Library
- Marquardt, N., Diaz-Marino, R., et al. (2011). The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. UIST '11, 315--326. Google ScholarDigital Library
- Marquardt, N., Hinckley, K., & Greenberg, S. (2012, October). Cross-Device Interaction via Micro-mobility and F-formations. UIST '12, 13--22. Google ScholarDigital Library
- Miller, R. C., & Myers, B. A. (1999). Synchronizing clipboards of multiple computers. UIST '99, 65--66. Google ScholarDigital Library
- Myers, B. A., Stiel, H., & Gargiulo, R. (1998). Collaboration using multiple PDAs connected to a PC. CSCW '98, 285--294. Google ScholarDigital Library
- Nacenta, M.A. et al. (2005). A Comparison of Techniques for Multi-Display Reaching. CHI 05, 371--380. Google ScholarDigital Library
- Pierce, J. S., Mahaney, H. E., & Abowd, G. D. (2003). Opportunistic annexing for handheld devices: Opportunities and challenges.Google Scholar
- Rekimoto, J. (1997, October). Pick-and-drop: a direct manipulation technique for multiple computer environments. UIST '97, 31--39. Google ScholarDigital Library
- Rekimoto, J. (1998). A multiple device approach for supporting whiteboard interactions. CHI '98 344--351. Google ScholarDigital Library
- Rekimoto, J., Saitoh, M. (1999). Augmented surfaces: a spatially continuous work space for hybrid computing environments. In Proc. CHI 99, 378--385. Google ScholarDigital Library
- Robinson, A. C. (2008). Design for Synthesis in Visualization. University Park, PA.Google Scholar
- Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., et al. Evaluating Visual Analytics at the 2007 VAST Symposium Contest. CG & A, IEEE, 28, 2 (MarchApril 2008), 12--21. Google ScholarDigital Library
- Santosa, S., Wigdor, D.(2013). A field study of multidevice workflows in distributed workspaces. UbiComp 13, 63--72. Google ScholarDigital Library
- Stefik, M., Bobrow, D., Lanning, S., and Tartar, D., (1987). WYSIWIS revised: early experiences with multiuser interfaces. In ACM Transactions on Information Systems, 5(2) (Apr. 1987), 147--167. Google ScholarDigital Library
- Streitz, N. A. et al. (1999). i-LAND: an interactive landscape for creativity and innovation. CHI 99, 120--127. Weiser, M. (1991). The computer for the 21st century. Scientific American, 265(3), 94--104. Google ScholarDigital Library
- Wigdor, D. et al. (2009) WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. CHI 09, 1237--1246. Google ScholarDigital Library
Index Terms
Conductor: enabling and understanding cross-device interaction
Recommendations
Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsDesigning interfaces or applications that move beyond the bounds of a single device screen enables new ways to engage with digital content. Research addressing the opportunities and challenges of interactions with multiple devices in concert is of ...
Distributing Interaction in Responsive Cross-Device Applications
ICWE 2016 International Workshops on Current Trends in Web Engineering - Volume 9881With the emergence of the Internet of Things there are many applications in which the interaction is distributed over multiple devices. Developing applications in these scenarios is challenging because there is not enough knowledge and even less ...
SMAC: A Simplified Model of Attention and Capture in Multi-Device Desk-Centric Environments
Prior research has demonstrated that users are increasingly employing multiple devices during daily work. Currently, devices such as keyboards, cell phones, and tablets remain largely unaware of their role within a user's workflow. As a result, ...
Comments