Skip to main content
SpringerLink
Log in
Book cover

Collaboration Meets Interactive Spaces pp 33–46Cite as

Spontaneous Gesture Production Patterns on Multi-touch Interactive Surfaces

  • Chapter
  • First Online:

Abstract

Expressivity of hand movements is much greater than what current interaction techniques enable in touch-screen input. Especially for collaboration, hands are used to interact but also to express intentions, point to the physical space in which collaboration takes place, and communicate meaningful actions to collaborators. Various types of interaction are enabled by multi-touch surfaces (singe and both hands, single and multiple fingers, etc.), and standard approaches to tactile interactive systems usually fail in handling such complexity of expresion. The diversity of multi-touch input also makes designing multi-touch gestures a difficult task. We believe that one cause for this design challenge is our limited understanding of variability in multi-touch gesture articulation, which affects users’ opportunities to use gestures effectively in current multi-touch interfaces. A better understanding of multi-touch gesture variability can also lead to more robust design to support different users’ gesture preferences. In this chapter we present our results on multi-touch gesture variability. We are mainly concerned with understanding variability in multi-touch gestures articulation from a pure user-centric perspective. We present a comprehensive investigation on how users vary their gestures in multi-touch gestures even under unconstrained articulation conditions. We conducted two experiments from which we collected 6669 multi-touch gestures from 46 participants. We performed a qualitative analysis of user gesture variability to derive a taxonomy for users’ multi-touch gestures that complements other existing taxonomies. We also provide a comprehensive analysis on the strategies employed by users to create different gesture articulation variations for the same gesture type.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. McNeill D (1992) Hand and mind: What gestures reveal about thought. University of Chicago Press, Psychology/cognitive science

    Google Scholar 

  2. Kita S (2009) Cross-cultural variation of speech-accompanying gesture: a review. In: Language and cognitive processes, pp 145–167

    Google Scholar 

  3. Morris MR, Wobbrock JO, Wilson AD (2010) Understanding users’ preferences for surface gestures. Proceedings of GI 2010. ON, Canada, Toronto, pp 261–268

    Google Scholar 

  4. Wobbrock JO, Morris MR, Wilson AD (2009) User-defined gestures for surface computing. Proceeding of CHI 2009. ACM, New York, NY, USA, pp 1083–1092

    Google Scholar 

  5. Ruiz J, Li Y, Lank E (2011) User-defined motion gestures for mobile interaction. Proceeding of CHI 2011 ACM. NY, USA, New York, pp 197–206

    Google Scholar 

  6. Morris MR (2012) Web on the wall: insights from a multimodal interaction elicitation study. Proceedings of ITS 2012. ACM, New York, NY, USA, pp 95–104

    Google Scholar 

  7. Vatavu RD (2013) A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments. J Ambient Intell Smart Environ:187–211

    Google Scholar 

  8. Vatavu R-D User-defined gestures for free-hand TV control. In: Proceedings of EuroiTV 2012. ACM, New York, NY, USA, pp 45–48

    Google Scholar 

  9. Bailly G, Müller J, Lecolinet E (2012) Design and evaluation of finger-count interaction: combining multitouch gestures and menus. Proceedings of IJHCS. Springer, Duluth, MN, USA, pp 673–689

    Google Scholar 

  10. Kin K, Agrawala M, DeRose T (2009) Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. Proceedings of GI 2009. ON, Canada, Toronto, pp 119–124

    Google Scholar 

  11. Wu M, Balakrishnan R Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In: Proceedings of UIST 2003. ACM, New York, NY, USA, pp 193–202

    Google Scholar 

  12. Anthony L, Vatavu R-D, Wobbrock JO (2013) Understanding the consistency of users’ pen and finger stroke gesture articulation. Proceedings of GI 2013. ON, Canada, Toronto, pp 87–94

    Google Scholar 

  13. Rekik Y, Grisoni L, Roussel N (2013) Towards many gestures to one command: a user study for tabletops. Proceedings of INTERACT. Springer, Berlin, Heidelber, pp 246–263

    Google Scholar 

  14. Hennecke F, Berwein F, Butz A (2011) Optical pressure sensing for tangible user interfaces. Proceedings of ITS 2011. ACM, New York, NY, USA, pp 45–48

    Google Scholar 

  15. Harrison C, Schwarz, J, Hudson SE TapSense: enhancing finger interaction on touch surfaces. In: Proceedings of UIST 2011. ACM, New York, NY, USA, pp 627–636

    Google Scholar 

  16. Lü H, Li Y (2012) Gesture coder: a tool for programming multi-touch gestures by demonstration. Proceedings of CHI 2012. ACM, New York, NY, USA, pp 2875–2884

    Google Scholar 

  17. Caramiaux B, Bevilacqua F, Tanaka A (2013) Beyond recognition: using gesture variation for continuous interaction. Proceedings of CHI 2013. ACM, New York, NY, USA, pp 2109–2118

    Google Scholar 

  18. Rekik Y, Vatavu R-D, Grisoni L (2014) Match-up & conquer: a two-step technique for recognizing unconstrained bimanual and multi-finger touch input. Proceedings of AVI. ACM, New York, NY, USA, pp 201–208

    Google Scholar 

  19. Hinrichs U, Carpendale S (2011) Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. Proceedings of CHI 2011. ACM, New York, NY, USA, pp 3023–3032

    Google Scholar 

  20. Freeman D, Benko H, Morris MR, Wigdor D (2009) ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. Proceedings of ITS 2009. ACM, New York, NY, USA, pp 165–172

    Google Scholar 

  21. Oh U, Findlater L (2013) The challenges and potential of end-user gesture customization. Proceedings of CHI 2013. ACM, New York, NY, USA, pp 1129–1138

    Google Scholar 

  22. Wu M, Shen C, Ryall K, Forlines C, Balakrishnan R (2006) Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. Proceedings of TABLETOP 2006. IEEE, Washington, DC, USA, pp 185–192

    Google Scholar 

  23. Ringel M, Ryall K, Shen C, Forlines C, Vernier F (2004) Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables. Proceedings of CHI EA 2004. ACM, New York, NY, USA, pp 1441–1444

    Google Scholar 

  24. Morris MR, Huang A, Paepcke A, Winograd T (2006) Cooperative gestures: multi-user gestural interactions for co-located groupware. Proceedings of CHI 2006. ACM, New York, NY, USA, pp 1201–1210

    Google Scholar 

  25. Bau O, Mackay WE (2008) OctoPocus: a dynamic guide for learning gesture-based command sets. Proceedings of UIST 2008. ACM, New York, NY, USA, pp 37–46

    Google Scholar 

  26. Kin K, Hartmann B, Agrawala M (2011) Two-handed marking menus for multitouch devices. Proceedings of TOCHI 2011. ACM, New York, NY, USA, pp 1073–0516

    Google Scholar 

  27. Kray C, Nesbitt D, Dawson J, Rohs M (2010) User-defined gestures for connecting mobile phones, public displays, and tabletops. Proceedings of mobile HCI 2010. ACM, New York, NY, USA, pp 239–248

    Google Scholar 

  28. Rekik Y, Vatavu R-D, Grisoni L (2014) Perceived difficulty understanding users’ of multi-touch gesture articulation. In: Proceedings of ICMI. ACM, New York, NY, USA

    Google Scholar 

  29. Huang TS, Pavlovic VI (1995) Hand gesture modeling, analysis, and synthesis. In: Workshop on automatic face and gesture recognition. IEEE, pp 73–79

    Google Scholar 

  30. Thieffry S (1981) Hand gestures. In: Tubiana R (ed) The hand. University of Chicago Press

    Google Scholar 

  31. Vatavu R-D, Anthony L, Wobbrock JO (2012) Gestures as point clouds: a $P recognizer for user interface prototypes. Proceedings of ICMI 2012. ACM, New York, NY, USA, pp 273–280

    Google Scholar 

  32. Tu H, Ren X, Zhai S (2012) A comparative evaluation of finger and pen stroke gestures. Proceedings of CHI 2012. ACM, New York, NY, USA, pp 1287–1296

    Google Scholar 

Download references

Acknowledgements

R.-D. Vatavu acknowledges support from the project PN-II-RUTE-2014-4-1187 financed by UEFISCDI, Romania.

Author information

Authors and Affiliations

  1. Mint, University of Lille Science & Technology, CNRS, INRIA, Villeneuve-d’Ascq, France

    Yosra Rekik & Laurent Grisoni

  2. MintViz Lab—MANSiD Research Center, University Stefan cel Mare of Suceava, Suceava, Romania

    Radu-Daniel Vatavu

Authors
  1. Yosra Rekik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Radu-Daniel Vatavu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Laurent Grisoni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yosra Rekik .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Middlesex University , London, United Kingdom

    Craig Anslow

  2. Madeira Interactive Technologies Institute, University of Madeira , Funchal, Reg. Aut. da Madeira, Portugal

    Pedro Campos

  3. Department of Computer Science & Engineering, Instituto Superior Técnico, University of Lisbon , Lisbon, Portugal

    Joaquim Jorge

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Rekik, Y., Vatavu, RD., Grisoni, L. (2016). Spontaneous Gesture Production Patterns on Multi-touch Interactive Surfaces. In: Anslow, C., Campos, P., Jorge, J. (eds) Collaboration Meets Interactive Spaces. Springer, Cham. https://doi.org/10.1007/978-3-319-45853-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45853-3_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45852-6

  • Online ISBN: 978-3-319-45853-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation