Skip to main content
SpringerLink
Log in

Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work

  • Chapter
  • First Online:
Book cover Collaboration Meets Interactive Spaces

Abstract

Large vertical displays are increasingly widespread, and content sharing between them and personal mobile devices is central to many collaborative usage scenarios. In this chapter we present FlowTransfer, bidirectional transfer techniques which make use of the mobile phone’s position and orientation. We focus on three main aspects: multi-item transfer and layout, the dichotomy of casual versus precise interaction, and support for physical navigation. Our five techniques explore these aspects in addition to being contributions in their own right. They leverage physical navigation, allowing seamless transitions between different distances to the display, while also supporting arranging content and copying entire layouts within the transfer process. This is enabled by a novel distance-dependent pointing cursor that supports coarse pointing from distance as well as precise positioning at close range. We fully implemented all techniques and conducted a qualitative study documenting their benefits. Finally, based on a literature review and our holistic approach in designing the techniques, we also contribute an analysis of the underlying design space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    see https://imld.de/flowtransfer/.

  2. 2.

    http://www.optitrack.com/.

  3. 3.

    https://www.libavg.de/.

  4. 4.

    http://opensoundcontrol.org/.

  5. 5.

    Photos from Flickr by    @dhilung (https://www.flickr.com/photos/dhilung),

                          @mualphachi (https://www.flickr.com/photos/mualphachi), and

                          @duncanh1 (https://www.flickr.com/photos/duncanh1),

     Map by GoogleMaps (https://maps.google.com).

References

  1. Alt F, Shirazi AS, Kubitza T, Schmidt A (2013) Interaction techniques for creating and exchanging content with public displays. In: Proceedings CHI 2013. ACM, pp. 1709–1718

    Google Scholar 

  2. Andrews C, Endert A, Yost B, North C (2011) Information visualization on large, high-resolution displays: issues, challenges, and opportunities. Inf Vis 10(4):341–355

    Article  Google Scholar 

  3. Ballagas R, Rohs M, Sheridan JG (2005) Sweep and point and shoot: Phonecam-based interactions for large public displays. In: Proceedings CHI 2005 Extended Abstracts. ACM, pp 1200–1203

    Google Scholar 

  4. Ball R, North C, Bowman DA (2007) Move to improve: promoting physical navigation to increase user performance with large displays. In: Proceedings CHI 2007. ACM, pp 191–200

    Google Scholar 

  5. Baur D, Boring S, Feiner S (2012) Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In: Proceedings CHI 2012. ACM, pp 1693–1702

    Google Scholar 

  6. Bezerianos A, Balakrishnan R (2005) The vacuum: facilitating the manipulation of distant objects. In: Proceedings CHI 2005. ACM, pp 361–370

    Google Scholar 

  7. Bolt RA (1980) “Put-that-there”: Voice and gesture at the graphics interface. In: Proceedings SIGGRAPH. ACM, pp 262–270

    Google Scholar 

  8. Boring, S, Altendorfer M, Broll G, Hilliges O, Butz A (2007) Shoot & copy: Phonecam-based information transfer from public displays onto mobile phones. In: Proceedings Mobility 2007. ACM, pp 24–31

    Google Scholar 

  9. Boring S, Baur D, Butz A., Gustafson S, Baudisch P (2010) Touch projector: Mobile interaction through video. In: Proceedings CHI 2010. ACM, pp 2287–2296

    Google Scholar 

  10. Bragdon A, DeLine R, Hinckley K, Morris MR (2011) Code space: Combining touch, devices, and skeletal tracking to support developer meetings. In: Proceedings ITS 2011. ACM, pp 212–221

    Google Scholar 

  11. Chung H, North C, Self JZ, Chu S, Quek F (2014) Visporter: facilitating information sharing for collaborative sensemaking on multiple displays. Pers Ubiquit Comput 18(5):1169–1186

    Article  Google Scholar 

  12. Dachselt R, Buchholz R (2008) Throw and Tilt—seamless interaction across devices using mobile phone gestures. In: Proceedings Workshop MEIS 2008. German Informatics Society (GI), pp 272–278

    Google Scholar 

  13. Frisch M, Langner R, Dachselt R (2011) Neat: a set of flexible tools and gestures for layout tasks on interactive displays. In: Proceedings ITS 2011. ACM, pp 1–10

    Google Scholar 

  14. Greenberg S, Marquardt N, Ballendat T, Diaz-Marino R, Wang M (2011) Proxemic interactions: the new ubicomp? Interactions 18(1):42–50

    Article  Google Scholar 

  15. Hardy R, Rukzio E (2008) Touch & interact: touch-based interaction of mobile phones with displays. In: Proceedings MobileHCI 2008. ACM, pp 245–254

    Google Scholar 

  16. Hassan N, Rahman MM, Irani P, Graham P (2009) Chucking: a one-handed document sharing technique. In: Proceedings INTERACT 2009. Springer, Berlin, Heidelberg, pp 264–278

    Google Scholar 

  17. Houben S, Marquardt N (2015) Watchconnect: a toolkit for prototyping smartwatch-centric cross-device applications. In: Proceedings CHI 2015. ACM, New York, NY, USA, pp 1247–1256

    Google Scholar 

  18. Jakobsen MR, Hornbæk K (2015) Is moving improving?: Some effects of locomotion in wall-display interaction. In: Proceedings CHI 2015. ACM, pp 4169–4178

    Google Scholar 

  19. Jokela T, Ojala J, Grassel G, Piippo P, Olsson T (2015) A comparison of methods to move visual objects between personal mobile devices in different contexts of use. In: Proceedings MobileHCI 2015. ACM, pp 172–181

    Google Scholar 

  20. Kabbash P, Buxton WAS (1995) The “prince” technique: Fitts’ law and selection using area cursors. In: Proceedings CHI 1995. ACM Press/Addison-Wesley Publishing Co., pp 273–279

    Google Scholar 

  21. Keefe DF, Gupta A, Feldman D, Carlis JV, Keefe SK, Griffin TJ (2012) Scaling up multi-touch selection and querying: Interfaces and applications for combining mobile multi-touch input with large-scale visualization displays. Int J Hum Comput Stud 70(10):703–713

    Article  Google Scholar 

  22. Kopper R, Bowman DA, Silva MG, McMahan RP (2010) A human motor behavior model for distal pointing tasks. Int J Hum Comput Stud 68(10):603–615

    Article  Google Scholar 

  23. Lehmann A, Staadt O (2013) Distance-aware bimanual interaction for large high-resolution displays. In: Computer vision, imaging and computer graphics. Theory and application, communications in computer and information science, vol 359. Springer, Berlin, pp 97–111

    Google Scholar 

  24. Marquardt N, Ballendat T, Boring S, Greenberg S, Hinckley K (2012) Gradual engagement: facilitating information exchange between digital devices as a function of proximity. In: Proceedings ITS 2012. ACM, pp 31–40

    Google Scholar 

  25. Müller J, Alt F, Michelis D, Schmidt A (2010) Requirements and design space for interactive public displays. In: Proceedings MM 2010. ACM, pp 1285–1294

    Google Scholar 

  26. Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings CHI 2002. ACM, pp 33–40

    Google Scholar 

  27. Nancel M, Chapuis O, Pietriga E, Yang XD, Irani PP, Beaudouin-Lafon M (2013) High-precision pointing on large wall displays using small handheld devices. In: Proceedings CHI 2013. ACM, pp 831–840

    Google Scholar 

  28. Nancel M, Pietriga E, Chapuis O, Beaudouin-Lafon M (2015) Mid-air pointing on ultra-walls. ACM Trans Comput Hum Interact 22(5), 21:1–21:62 (2015)

    Google Scholar 

  29. Norman DA (2002) The design of everyday things. Basic Books, Inc

    Google Scholar 

  30. Peck SM, North C, Bowman D (2009) A multiscale interaction technique for large, high-resolution displays. In: IEEE symposium on 3D user interfaces 2009. IEEE, pp 31–38

    Google Scholar 

  31. Pohl H, Murray-Smith R (2013) Focused and casual interactions: allowing users to vary their level of engagement. In: Proceedings CHI 2013. ACM, pp 2223–2232

    Google Scholar 

  32. Rädle R, Jetter HC, Butscher S, Reiterer H (2013) The effect of egocentric body movements on users’ navigation performance and spatial memory in zoomable user interfaces. In: Proceedings ITS 2013. ACM, pp 23–32

    Google Scholar 

  33. Rashid U, Nacenta MA, Quigley A (2012) The cost of display switching: a comparison of mobile, large display and hybrid ui configurations. In: Proceedings AVI 2012. ACM, pp 99–106

    Google Scholar 

  34. Rekimoto J (1997) Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings UIST 1997. ACM, pp 31–39

    Google Scholar 

  35. Schmidt D, Chehimi F, Rukzio E, Gellersen H (2010) Phonetouch: a technique for direct phone interaction on surfaces. In: Proceedings UIST 2010. ACM, pp 13–16

    Google Scholar 

  36. Schmidt D, Seifert J, Rukzio E, Gellersen H (2012) A cross-device interaction style for mobiles and surfaces. In: Proceedings DIS 2012. ACM, pp 318–327

    Google Scholar 

  37. Seifert J, Bayer A, Rukzio E (2013) Pointerphone: using mobile phones for direct pointing interactions with remote displays. In: Kotzé P, Marsden G, Lindgaard G, Wesson J, Winckler M (eds) Human-Computer Interaction—INTERACT 2013, vol 8119. Springer, Berlin, Heidelberg, pp 18–35

    Chapter  Google Scholar 

  38. Seifert J, Dobbelstein D, Schmidt D, Holleis P, Rukzio E (2014) From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces. Pers Ubiquit Comput 18(4):1013–1026

    Article  Google Scholar 

  39. Tan DS, Czerwinski M (2003) Effects of visual separation and physical discontinuities when distributing information across multiple displays. Proc INTERACT 2003:252–255

    Google Scholar 

  40. Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings UIST 2005. ACM, pp 33–42

    Google Scholar 

  41. von Zadow U, Büschel W, Langner R, Dachselt R (2014) Sleed: using a sleeve display to interact with touch-sensitive display walls. In: Proceedings ITS 2014. ACM, pp 129–138

    Google Scholar 

  42. Wagner J, Nancel M, Gustafson SG, Huot S, Mackay WE (2013) Body-centric design space for multi-surface interaction. In: Proceedings CHI 2013. ACM, pp 1299–1308

    Google Scholar 

Download references

Acknowledgements

We thank Wolfgang Büschel, Ulrike Kister, Fabrice Matulic, and other members of the Interactive Media Lab for their feedback and helpful suggestions. We would also like to thank students of the lab for their support on the prototype. Finally, we thank our anonymous reviewers for their valuable and helpful comments.

Author information

Authors and Affiliations

  1. Interactive Media Lab, Technische Universität Dresden, Dresden, Germany

    Ricardo Langner, Ulrich von Zadow, Tom Horak, Annett Mitschick & Raimund Dachselt

Authors
  1. Ricardo Langner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ulrich von Zadow
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tom Horak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Annett Mitschick
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Raimund Dachselt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ricardo Langner .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Middlesex University , London, United Kingdom

    Craig Anslow

  2. Madeira Interactive Technologies Institute, University of Madeira , Funchal, Reg. Aut. da Madeira, Portugal

    Pedro Campos

  3. Department of Computer Science & Engineering, Instituto Superior Técnico, University of Lisbon , Lisbon, Portugal

    Joaquim Jorge

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Langner, R., von Zadow, U., Horak, T., Mitschick, A., Dachselt, R. (2016). Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. In: Anslow, C., Campos, P., Jorge, J. (eds) Collaboration Meets Interactive Spaces. Springer, Cham. https://doi.org/10.1007/978-3-319-45853-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45853-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45852-6

  • Online ISBN: 978-3-319-45853-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation