skip to main content
10.1145/1629826.1629859acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihmConference Proceedingsconference-collections
research-article

Espace de caractérisation des interactions gestuelles physiques sur dispositifs mobiles

Published: 13 October 2009 Publication History

Abstract

Mobile interaction has become one of the most prominent fields in HCI. Because interaction resources are limited (small sized screen, no physical keyboard), and due to the specific constraints involved in mobile usage, many new interaction techniques have been proposed for handheld devices in recent years. This paper reviews the state of the art for gesture-based physical interaction and the techniques that rely on this concept. We also propose a design space aimed at classifying the existing techniques in regards to the specific issues involved in mobile interaction.

References

[1]
Baffoun, S. and Robert, J. 2006. État de l'art des techniques de présentation d'information sur écran d'assistant numérique personnel. In Proc. of IHM06 (Montreal, Canada, April 18--21, 2006). vol. 133. ACM, New York, NY, 27--34.
[2]
Bailly, G., Roudaut, A., Lecolinet, E., and Nigay, L. 2008. Menus leaf: enrichir les menus linéaires par des gestes. In Proc. of IHM08 (Metz, France, September 02--05, 2008). vol. 339. ACM, New York, NY, 169--172.
[3]
Ballagas, R., Borchers, J., Rohs, M., Sheridan, J. G., 2006 "The Smart Phone: A Ubiquitous Input Device," IEEE Pervasive Computing, vol. 5, no. 1, pp. 70--77, January-March, 2006.
[4]
Bartlett, J. F. 2000. Rock'n' Scroll Is Here to Stay. IEEE Comput. Graph. Appl. 20, 3 (May. 2000), 40--45.
[5]
Baudisch, P. and Chu, G. 2009 Back-of-device Interaction allows creating very small touch devices In Proceedings of CHI 2009, Boston, MS, April 4--9, 2009
[6]
Baudisch, P. and Rosenholtz, R. 2003. Halo: a technique for visualizing off-screen objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05--10, 2003). CHI'03. ACM, New York, NY, 481--488.
[7]
Beaudouin-Lafon, M. 2000. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01--06, 2000). CHI'00. ACM, New York, NY, 446--453.
[8]
Cadoz, C. 1994. Le geste, canal de communication homme/machine: la communication instrumentale. Technique et Science de l'information, 13(1): pp. 31--61.
[9]
Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Vanderdonckt, J. 2002. Plasticity of User Interfaces: A revised reference framework. TAMODIA'02.
[10]
Ferscha, A., Vogl, S., Emsenhuber, B., and Wally, B. 2007. Physical shortcuts for media remote controls. In Proceedings of the 2nd international Conference on intelligent Technologies For interactive Entertainment (Cancun, Mexico, January 08--10, 2008). ICST (Institute for Computer Sciences Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, 1--8.
[11]
Hachet, M., Pouderoux, J., and Guitton, P. 2005. A camera-based interface for interaction with mobile handheld computers. In Proceedings of the 2005 Symposium on interactive 3D Graphics and Games (Washington, District of Columbia, April 03--06, 2005). I3D'05. ACM, New York, NY, 65--72.
[12]
Haro, A., Mori, K., Setlur, V., and Capin, T. 2005. Mobile camera-based adaptive viewing. In Proceedings of the 4th international Conference on Mobile and Ubiquitous Multimedia (Christchurch, New Zealand, December 08--10, 2005). MUM'05, vol. 154. ACM, New York, NY, 78--83.
[13]
Hinckley, K. 2003. Synchronous gestures for multiple persons and computers. In Proceedings of the 16th Annual ACM Symposium on User interface Software and Technology (Vancouver, Canada, November 02--05, 2003). UIST'03. ACM, New York, NY, 149--158.
[14]
Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (San Diego, California, United States, November 06--08, 2000). UIST'00. ACM, New York, NY, 91--100.
[15]
Karam, M. and Schraefel, M. C. (2005) A Taxonomy of Gesture in Human Computer Interactions. Technical Report ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton.
[16]
Karlson, A. K., Bederson, B. B., and SanGiovanni, J. 2005. AppLens and launchTile: two designs for one-handed thumb use on small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA, April 02--07, 2005). CHI'05. ACM, New York, NY, 201--210.
[17]
Kauppila M (2008) Filler Models for Accelerometer Based Continuous Gesture Recognition. Sc. Thesis, Dept. of Mathematical Sciences, University of Oulu, May 2008.
[18]
Kauppila M, Inkeroinen T, Pirttikangas S&Riekki J (2008) Mobile Phone Controller Based on Accelerative Gesturing. Adjunct Proceedings Pervasive 2008, Sydney, Australia, 130--133.
[19]
Keim, D. A. 2002. Information Visualization and Visual Data Mining. IEEE Transactions on Visualization and Computer Graphics 8, 1 (Jan. 2002), 1--8.
[20]
Ladetto, Q., Merminod, B. 2002. Digital magnetic compass and gyroscope integration for pedestrian navigation. 9thinternational conference on integrated navigation systems, St-Petersburg, 27--29 May 2002.
[21]
Linjama, J. and Kaaresoja, T. 2004. Novel, minimalist haptic gesture interaction for mobile devices. In Proceedings of the Third Nordic Conference on Human-Computer interaction (Tampere, Finland, October 23--27, 2004). NordiCHI'04, vol. 82. ACM, New York, NY, 457--458.
[22]
Murray-Smith, R., Williamson, J., Hughes, S., Quaade, T., and Strachan, S. 2008. Rub the stane. In CHI'08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05--10, 2008). CHI'08. ACM, New York, NY, 2355--2360.
[23]
Nigay, L., Coutaz, J. Espaces conceptuels pour l'interaction multimédia et multimodale. TSI, spécial Multimédia et Collecticiel, AFCET&Hermes Publ., Vol 15(9), 1996, pp. 1195--1225.
[24]
Oakley, I. and Park, J. 2007. A motion-based marking menu system. In CHI'07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 - May 03, 2007). CHI'07. ACM, New York, NY, 2597--2602.
[25]
Pering, T., Anokwa, Y., and Want, R. 2007. Gesture connect: facilitating tangible interaction with a flick of the wrist. In Proc. of TEI'07 (Baton Rouge, Louisiana, February 15--17, 2007). TEI'07. ACM, New York, NY, 259--262.
[26]
Poirier, F., Schadle, I., État de l'art des méthodes de saisie de données sur dispositifs nomades, IHM 2004.
[27]
Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E. 2000. Control menus: excecution and control in a single interactor. In CHI'00 Extended Abstracts on Human Factors in Computing Systems (The Hague, The Netherlands, April 01--06, 2000). CHI'00. ACM, New York, NY, 263--264.
[28]
Rahman, M., Gustafson, S., Irani, P., and Subramanian, S. 2009. Tilt techniques: investigating the dexterity of wrist-based input. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 1943--1952.
[29]
Rehm, M., Bee, N., André, E. 2008. Wave Like an Egyptian --- Accelerometer Based Gesture Recognition for Culture Specific Interactions. In Procedings of HCI 2008 Culture, Creativity, Interaction, (2008).
[30]
Roudaut A., Baglioni M. et Lecolinet E. 2009. TimeTilt: Using Sensor-Based Gestures to Travel Through Multiple Applications on a Mobile Device. In Proc. of INTERACT'09.
[31]
Roudaut, A. et Lecolinet, E. 2007. Un espace de classification pour l'interaction sur dispositifs mobiles. IHM'07.
[32]
Roudaut, A., Huot, S., and Lecolinet, E. 2008. Tap-Tap and MagStick: improving one-handed target acquisition on small touch-screens. In Proceedings of the Working Conference on Advanced Visual interfaces (Napoli, Italy, May 28--30, 2008). AVI'08. ACM, New York, NY, 146--153.
[33]
Roudaut, A., Lecolinet, E., and Guiard, Y. 2009. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proc. of CHI09 (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 927--936.
[34]
Schlömer, T., Poppinga, B., Henze, N., and Boll, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18--20, 2008). TEI'08. ACM, New York, NY, 11--14.
[35]
Shneiderman, B. 1996. The eyes have it: A task by data type taxonomy of information visualizations, Proc. IEEE Symposium on Visual Languages '96, IEEE, Los Alamos, CA (September 1996), pg 336--34.
[36]
Sirisena, A., 2002. Mobile Text Entry, Rapport en informatique, Université de Canterbury (NZ), 2002.
[37]
Wigdor, D. and Balakrishnan, R. 2003. TiltText: using tilt for text input to mobile phones. In Proc. of UIST'03 (Vancouver, Canada, November 02--05, 2003). UIST'03. ACM, New York, NY, 81--90.
[38]
Wobbrock, J. O., Morris, M. R., and Wilson, A. D. 2009. User-defined gestures for surface computing. In Proc. CHI09 (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 1083--1092.
[39]
Wobbrock, J., Myers, B., and Rothrock, B. 2006. Few-key text entry revisited: mnemonic gestures on four keys. In Proc. of CHI'06 (Montréal, Québec, Canada, April 22--27, 2006). R. Grinter, T. Rodden, P. Aoki, E. Cutrell, R. Jeffries, and G. Olson, Eds. CHI'06. ACM, New York, NY, 489--492.
[40]
http://www.realeyes3d.com/
[41]
http://www.apple.com/iphone
[42]
http://www.sonyericsson.com/
[43]
http://www.tat.se/
[44]
http://www.jmobil.fr/jeu-iphone/1491-shakeit.html
[45]
http://www.htc.com/
[46]
http://www.nitendo.fr/
[47]
http://www.techcrunch.com/2008/09/17/sgn-launches-igolf-for-iphone-wii-action-is-here/
[48]
http://wiki.openmoko.org/wiki/Neo_FreeRunner/fr
[49]
http://www.ssec.honeywell.com/magnetic/
[50]
http://www.france-powerball.com/
[51]
http://www.segway.fr/
[52]
http://www.pranavmistry.com/projects/sixthsense/

Cited By

View all

Index Terms

  1. Espace de caractérisation des interactions gestuelles physiques sur dispositifs mobiles

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      IHM '09: Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
      October 2009
      354 pages
      ISBN:9781605584614
      DOI:10.1145/1629826
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 October 2009

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. embodied interaction
      2. gestural language
      3. interaction technique
      4. mobile device
      5. physical interaction

      Qualifiers

      • Research-article

      Conference

      IHM '09

      Acceptance Rates

      Overall Acceptance Rate 103 of 199 submissions, 52%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 25 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media