Skip to main content
SpringerLink
Log in

A Gesture-Based Interaction Approach for Manipulating Augmented Objects Using Leap Motion

  • Conference paper
  • First Online:
Ambient Assisted Living. ICT-based Solutions in Real Life Situations (IWAAL 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9455))

Included in the following conference series:

Abstract

Ambient Intelligence and Ubiquitous Computing are carrying the world to a reality where almost every object interacts with the environment, either via sensors or actuators, and users must learn how to interact with such systems. This paper presents a gesture-based interaction approach to manipulate such objects. We developed a prototype using a leap motion controller as a hand-tracking device, and a Support Vector Machine as a classifier to distinguish between gestures. Our system was evaluated by 12 users with over 10 commands. We also show a review on gesture-based interaction and compare other proposals with ours.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. López, G., López, M., Guerrero, L.A., Bravo, J.: Human-objects interaction: a framework for designing, developing and evaluating augmented objects. Int. J. Hum.-Comput. Inter. 30(10), 787–801 (2014)

    Article  Google Scholar 

  2. Yuksel, K.A., Adali, S.H.: Prototyping input controller for touch-less interaction with ubiquitous environments. In: International Conference on Human Computer Interaction with Mobile Devices and Services (2011)

    Google Scholar 

  3. Leap Motion, Inc. www.leapmotion.com

  4. Pavlovic, V., Sharma, R., Huang, T.: Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 677–695 (1997)

    Article  Google Scholar 

  5. Elepfandt, M., Sünderhauf, M.: Multimodal, touchless interaction in spatial augmented reality environments. In: Duffy, V.G. (ed.) ICDHM 2011. LNCS, vol. 6777, pp. 263–271. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  6. Saidinejad, H., Veronese, F., Comai, S., Salice, F.: Towards a hand-based gestural language for smart-home control using hand shapes and dynamic hand movements. In: Hervás, R., Lee, S., Nugent, C., Bravo, J. (eds.) UCAmI 2014. LNCS, vol. 8867, pp. 268–271. Springer, Heidelberg (2014)

    Google Scholar 

  7. Ng, W.L., Ng, C.K., Noordin, N.K., Ali, B.M.: Gesture based automating household appliances. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 285–293. Springer, Heidelberg (2011)

    Google Scholar 

  8. Pan, G., Wu, J., Zhang, D., Wu, Z., Yang, Y., Li, S.: GeeAir: a universal multimodal remote control device for home appliances. Pers. Ubiquit. Comput. 14(8), 723–735 (2010)

    Article  Google Scholar 

  9. Suau, X., Alcoverro, M., Lopez-Mendez, A., Ruiz-Hidalgo, J., Casas, J.: INTAIRACT: joint hand gesture and fingertip classification for touchless interaction. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part III. LNCS, vol. 7585, pp. 602–606. Springer, Heidelberg (2012)

    Google Scholar 

  10. Jaimes, A., Sebe, N.: Multimodal human computer interaction: a survey. In: Sebe, N., Lew, M., Huang, T.S. (eds.) HCI/ICCV 2005. LNCS, vol. 3766, pp. 1–15. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  11. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    MATH  Google Scholar 

  12. Scikit-Learn, Machine Learning in Python. http://scikit-learn.org/

  13. Ben-Hur, A., Weston, J.: Data Mining Techniques for the Life Sciences. Humana Press, Totowa (2010)

    Google Scholar 

  14. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: ACM SIGCHI Conference on Human Factors in Computing Systems (1997)

    Google Scholar 

  15. Kawsar, F., Fujinami, K., Nakajima, T.: Augmenting everyday life with sentient artefacts. In: Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-Aware Services: Usages and Technologies (2005)

    Google Scholar 

  16. Chung, K., Shilman, M., Merrill, C., Ishii, H.: OnObject: gestural play with tagged everyday objects. In: ACM Symposium on User Interface Software and Technology (2010)

    Google Scholar 

  17. Sra, M., Lee, A., Pao, S., Jiang, G., Ishii, H.: Point and share: from paper to whiteboard. In: ACM Symposium on User Interface Software and Technology (2012)

    Google Scholar 

  18. Navarro, G.: A guided tour to approximate string matching. ACM Comput. Surv. 33(1), 31–88 (2001)

    Article  Google Scholar 

  19. Rempel, D., Camilleri, M., Lee, D.: The design of hand gestures for human–computer interaction: lessons from sign language interpreters. Int. J. Hum Comput Stud. 72(10–11), 728–735 (2014)

    Article  Google Scholar 

  20. Hein, A., Hoffmeyer, A., Kirste, T.: Utilizing an accelerometric bracelet for ubiquitous gesture-based interaction. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 519–527. Springer, Heidelberg (2009)

    Google Scholar 

  21. Moya, J.M., de Espinosa, A.M., Araujo, Á., de Goyeneche, J.-M., Vallejo, J.C.: Low-cost gesture-based interaction for intelligent environments. In: Omatu, S., Rocha, M.P., Bravo, J., Fernández, F., Corchado, E., Bustillo, A., Corchado, J.M. (eds.) IWANN 2009, Part II. LNCS, vol. 5518, pp. 752–755. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  22. Wu, J., Pan, G., Li, S., Wu, Z., Zhang, D.: GeeAir: waving in the air to control home appliances. In: Ubiquitous Intelligence Computing and 7th International Conference on Autonomic Trusted Computing (2010)

    Google Scholar 

  23. Fernández, M.Á., Peláez, V., López, G., Carus, J.L., Lobato, V.: Multimodal interfaces for the smart home: findings in the process from architectural design to user evaluation. In: Bravo, J., López-de-Ipiña, D., Moya, F. (eds.) UCAmI 2012. LNCS, vol. 7656, pp. 173–180. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

Download references

Acknowledgments

This work was partially supported by Centro de Investigaciones en Tecnologías de la Información y Comunicación at Universidad de Costa Rica (CITIC-UCR) grand No. 834-B4-159, by Escuela de Ciencias de la Computación e Informática at Universidad de Costa Rica (ECCI-UCR), by Ministerio de Ciencia, Tecnología y Telecomunicaciones (MICITT), and by Consejo Nacional para Investigaciones Científicas y Tecnológicas (CONICIT) of the Government of Costa Rica.

Author information

Authors and Affiliations

  1. Centro de Investigaciones en Tecnologías de la Información y Comunicación, Universidad de Costa Rica, UCR, San Pedro, Costa Rica

    Gustavo López & Luis A. Guerrero

  2. Escuela de Ciencias de la Computación e Informática, Universidad de Costa Rica, UCR, San Pedro, Costa Rica

    Luis Quesada & Luis A. Guerrero

Authors
  1. Gustavo López
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luis Quesada
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luis A. Guerrero
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gustavo López .

Editor information

Editors and Affiliations

  1. University of Ulster, Londonderry, United Kingdom

    Ian Cleland

  2. Universidad de Costa Rica, San Jose, Costa Rica

    Luis Guerrero

  3. University of Castilla-La Mancha, CIUDAD REAL, Ciudad Real, Spain

    José Bravo

Appendix

Appendix

The Table shown in this Appendix shows the results of 12 users that tested our system. Results are grouped by sex and leading hand.

User Group

Sign

Attempts

Recognized signs

Female (right handed) N = 3

Movement

12

9

Turn on/off

6

5

In

6

5

Out

6

6

Male (right handed) N = 8

Movement

32

26

Turn on/off

16

14

In

16

15

Out

16

12

Male (left handed) N = 1

Movement

4

3

Turn on/off

2

1

In

2

1

Out

2

1

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

López, G., Quesada, L., Guerrero, L.A. (2015). A Gesture-Based Interaction Approach for Manipulating Augmented Objects Using Leap Motion. In: Cleland, I., Guerrero, L., Bravo, J. (eds) Ambient Assisted Living. ICT-based Solutions in Real Life Situations. IWAAL 2015. Lecture Notes in Computer Science(), vol 9455. Springer, Cham. https://doi.org/10.1007/978-3-319-26410-3_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26410-3_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26409-7

  • Online ISBN: 978-3-319-26410-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation