Skip to main content
SpringerLink
Log in

Multi-modal Contact-Less Human Computer Interaction

  • Conference paper
Enterprise Information Systems (ICEIS 2006)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 3))

Included in the following conference series:

Abstract

We describe a contact-less Human Computer Interaction (HCI) system that aims to provide paraplegics the opportunity to use computers without the need for additional invasive hardware. The proposed system is a multi-modal system combining both visual and speech input. Visual input is provided through a standard web camera used for capturing face images showing the user of the computer. Image processing techniques are used for tracking head movements, making it possible to use head motion in order to interact with a computer. Speech input is used for activating commonly used tasks that are normally activated using the mouse or the keyboard. The performance of the proposed system was evaluated using a number of specially designed test applications. According to the quantitative results, it is possible to perform most HCI tasks with the same ease and accuracy as in the case that a touch pad of a portable computer is used.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Assistive Technology Solutions (Last Accessed: July 2007), http://www.abilityhub.com/mouse/

  2. CameraMouse: Hands Free Computer Mouse (Last Accessed: July 2007), http://cameramouse.com/

  3. EyeTech Digital Systems-Eye Tracking Device (Last Accessed: July 2007), http://www.eyetechds.com/

  4. Frangeskides, F., Lanitis, A.: A Hands-Free Non-Invasive Human Computer Interaction System. In: Proceedings of the International Joint Conferences on Computer, Information, and Systems Sciences, and Engineering (2005)

    Google Scholar 

  5. Gorodnichy, D.O., Roth, G.: Nouse ’Use Your Nose as a Mouse’ - Perceptual Vision Technology for Hands-Free Games and Interfaces. Image and Vision Computing 22, 931–942 (2004)

    Article  Google Scholar 

  6. Kettebekov, S., Sharma, R.: Toward Natural Gesture/Speech Control of a Large Display. In: Nigay, L., Little, M.R. (eds.) EHCI 2001. LNCS, vol. 2254, pp. 221–234. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  7. Krahnstoever, N., Kettebekov, S., Yeasin, M., Sharma, R.: A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays. In: ICMI 2002. Proceedings of Fourth Intl. Conference on Multimodal Interfaces (2002)

    Google Scholar 

  8. Mateos, G.G.: Refining Face Tracking With Integral Projections. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 360–368. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  9. Microsoft Speech - Speech SDK5.1 For Windows Applications (Last Accessed: July 2007), http://www.microsoft.com/speech/download/sdk51/

  10. Mouse Vision Assistive Technologies (Last Accessed: July 2007), http://mousevision.com/

  11. Origin Instruments Corporation (Last Accessed: July 2007), http://www.orin.com/3dtrack/

  12. O’Shaughnessy, D.: Interacting with computers by voice: automatic speech recognition and synthesis. IEEE Proceedings 91, 1272–1305 (2003)

    Article  Google Scholar 

  13. Smart-Nav: Hands Free Mouse AT Assistive Technology (Last Accessed: July 2007), http://www.naturalpoint.com/smartnav/

  14. Potamianos, G., Neti, C., Gravier, G., Garg, A., Senior, A.W.: Recent advances in the automatic recognition of audiovisual speech. IEEE Proceedings 91, 1306–1326 (2003)

    Article  Google Scholar 

  15. Toyama, K.: Look, Ma - No Hands! - Hands Free Cursor Control with Real Time 3D Face Tracking. In: Proceedings Of Workshop on Perceptual User Interfaces, pp. 49–54 (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Cyprus College, PO Box 22006, Nicosia, 1516, Cyprus

    Frangiskos Frangeskides

  2. Department of Multimedia and Graphic Arts, Cyprus University of Technology, P.O Box 50329, Lemesos, 3066, Cyprus

    Andreas Lanitis

Authors
  1. Frangiskos Frangeskides
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andreas Lanitis
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Yannis Manolopoulos Joaquim Filipe Panos Constantopoulos José Cordeiro

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Frangeskides, F., Lanitis, A. (2008). Multi-modal Contact-Less Human Computer Interaction. In: Manolopoulos, Y., Filipe, J., Constantopoulos, P., Cordeiro, J. (eds) Enterprise Information Systems. ICEIS 2006. Lecture Notes in Business Information Processing, vol 3. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77581-2_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77581-2_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77580-5

  • Online ISBN: 978-3-540-77581-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation